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FOREWORD 



Evaluation is 'an integral part of the process by which 
^schools cari improve their educational program's^- Through the 
information generated by evaluative activities, sounder decisions 
can be made about the effects of instruction on pupil learning. 

4 The Cleveland Public Schools are proud of the '-Department 

of Research, Development and Evaluation for the excellent evalua-. 
J:ive\i>ervice^ provided for Title I programs. 

•This publication, Title I - Evaluation Reports- -1980-81 
presents the latest findings about the effects of Title I programs 
in the Cleveland schools. ® ' 



Peter P. Carlih 

Superintendent of School 

..j 
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INTRODUCTION 

since the spring of 1966, the Cleveland Public Schools 
have implemented program components under Title I of the Elementary 
and Secondary Education Act. These components have been directed 
at improvement of educational opportunities for disadvantaged youth 
attending Cleveland schools; * ^ 

Members of the Department bf Research, Development and 
Evaluation have had the responsibility for designing and implement- 
ing the evaluation of these program components. This publication S 
contains their evaluation reports for the 1980-81 program period. 
These, reports present information about the effectiveness of each 
program in attaining the objectives proposed for each component. 



Margaret Fleming 
Deputy Superintendent 
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1980-1981 



CHILD DEVELOPMENT 



X 1980-8L> Title I Evaluation 



PURPOSE AND OVERVIEW 



The Child Development Project gives eligible four-year old children 
basic experiences not generally, available in the Home. These experiences help 
the children develop learning skills needed for success in school. Language 
and other pre-reading skills are emphasized. Each project class includes about 
20 children, who attend for a half>-day, five days a week. Each class has a 
teacher and an aide, and parents are encouraged to work with their children 
at .school .and at home. 



SERVICE SUMMARY 



Pupils Served : 1,483 Grades Served : Pre-K Years in Operation : 16.5 



Schools : 35' 
public 

(See Appendix A.) 



Staffing: 

r 

1 Project Manager (FT) . 

5 Coordinators (PT - 40%}: 
Curriculum; Supportive 
Services; Field Services; 
Dental; Health/Nursing- 

5 Consultant Teachers (3 FT" 
Curriculum/Instruction; 2 PT 
- 40%:^Spec< Servs.; Rdg.) 

* 36 Teachers (35 FT; 1 PT - 50%) 



5 Social Workers 
(4 FT; 1 PT - 40%) 

1 Speech Therapist 
(FT) 

35 Educational Aides * 
. (34 FT; 1 PT - 50%) 

3 Clerks (FT) ' 

3 Laborers (FT) 



Total Title I Expenditures : $624,613 



Per Pupil Cost : t $421 



SUMMARY, OF FINDINGS 



\ 



During*1980-1981 Child Development operated as proposed. Class- 
room and other project staff participated in a wide, variety of inservice 
activities. Teacher consultants visited each project classroom at least 
three times; the average number of observations was eight. Project staff - 
worked with other school and community personnel to provide maximum sup- 
portive services for Child Development pupils and their families* 

- y 

Children's average gains in both language ancNnathematics exceeded 
those expected. Their .average score in language jnoved from the /bottom fourth 
to the national average. Also, in areas of self-sufficiency, emotional matu- 
rity,* social skills and self-Concept , the pupils V average gains were greater 
thaiTproposed. In all these, the 1980-1981 gapLns were greater than the pre- 
ceding year — possibly attributable to a school year with fewer disruptions 
as well as to prdject' staff's ongoing efforts to improve their skills. 
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OBJECTIVES AND QUTCQNES 

r 

• Process Objective 1 : Differentiated inservice meetings will be sched- 
uled for instructional and supportive services personnel. 

. Outcome : Project records clearly indicated that this objective was 
attained. 

• . The Child Development staff, with other Early Childhood personnel, 
provided several 4, (series of) inservice sessions * such as: ' 

f - Affirmative Education Phase III (9/17,18,19/80) emphasizing 
staff learning/teaching styles; 

- Early Childhood's Role in Bilingual Education (12/12/80); 

- Affirmative Education Phase IV (2/12/Sl) focusing on multicul- 
tural education. 

. Child Development teachers had a special meeting with the directing 
supervisors for Compensatory Education Programs and Early Childhood 
Education relevant to end-of-school-year procedures (5/28/81). 

Social workers were inserviced by the Supportive Services Coordi- 
nator on at least two occasions (10/1Q/80; 3/30/81). 

. All project teachers and classroom aides participated in workshops 
on assessment and language experiences. 

- Instructional staff were first inserviced on the use of a new 
assessment tool in the fall (10/6,7,8/80) , with a follow-up work- 
shop several weeks later (12/15,16/80). (The assessment instru- 
ment provides detailed direct idns for observing, and fonhs for 
periodically recording, each child's level of mastery ; of care- 
fully specified skills in areas such as motor, social, visual 
memory, auditory discrimination.) On reaction sheets completed 
at the close of these Workshops;, 97% of the participants rated 
them "excellent 11 or "good. 11 , 

- All classroom staff were involved* in one oi^two LEIEC (^Language 
Experiences Individualized and Extended for young Children) work- 
shops. Those from 15 schools introduced to LEIEC (Turing 1979- 
1980 met on February 23 or 24,' 1981; those from the other 21 
schools were introduced to LEIEC on March 18 or 19, 1981. Rat- 
ings of "excellent 11 or "good 11 were submitted by all participants. 

v . Project teacjie* consultants — who received formal inservice them- 
selves (10/17/80; 3/12/81) --provided for ^classroom teachers and 
assistants the most highly differentiated inservice of all. Each 
Child Development teacher was provided individualized, on-site 
inservice by a teacher consultant on at least three occasions 
during 1980-1981; the mtedian number of visits/observations was 
eight per teacher. 



Process Objective 4 1 - (continued). 

r ■ 

. Beyond ins§rvice training specifically provided by and for pro- 
ject personnel, staff engaged in a variety of professional-growth 
activities. < Benef its of these more individual efforts, such as 
those noted below, were shared appropriately with other project 
staff. ; % * . , 

f j p / 

~ Project "central staff 1 were involved # in orientation to the 
Bowdoin model (for parents of preschool and first-grade child- 
ren) on September 25, 1980 and to services of the Mental De- 
< velopment Center (November 14, 1980). Child Development was 
represented at the Indochinese Conference in Columbus, Ohio 
(9/30-10/1/80), and— by the Curriculum Coordinator- -at the 
NAEYC (National Association for Education of Young Children) 
Conference in Francisco, California (11/20-23/80). 

- Project supportive and "central" staff members received informal, 
individual inservice training through maintenance of contacts 
with professional special-interest groups within and beyond the 
the school system. The following were typical examples,. 

= The Health/Nursing Coordinator met not only with ^ghool 

s nurses but also with the Metropolitan Health Planning 

£ Corporation (12/23/80; l/27, 2/23/81) anti other health- 

i oriented community groups. - m ^ 

9 = The Field Services Coordinator was actively involved with 

the Federation for Community Planning and other social 

agencies. - , ^ 

< 

= Child Development social workers, with other Early Childhood 
staff in this discipline, met not only with the Coordinator 
of Supportive Services for inservice (10/10/80; 3/30/81) but 
^toere regularly represented at sessions of the National As- 
sociation of Social Workers. 

= The Speech Therapist assigned to Child Development continued 
to participate in syst§mwide inservice for speech staff. 

Process Objective 1 ; Utilization of effective teaching techniques' will 
be encouraged through use of a Classroom v Observation Checklist with each 
teacher at least once during the year. 

. Outcome : This objective was not attained during 1980-1981. Teacher 
consultants 1 records indicated that they had used the Checklist 
(Appendix B) with? most (91.4*)— but not all— Child Development teach- . 
ers during their on-site visits/observations (mentioned Just above, 
in relation to the first process objective). Checklists completed 
by the consultants were discussed and left on file with the teachers, 
following observations. 

-7- 
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Process Objective* 3, : -Health maintenance and social competency of fami- 
lies of participants- wilTtfe encouraged through cooperative efforts of 
project staff, school staff and community resoijrces.' % 

. Outcome : Project records documented attainment of this objective. 

. Three issues of The Bridge (newsletter for parents of children in 
Early- 'Childhood Education programs) were sent home with pupils-- 
in January, March and June*> 1981. Through 'words , and pictures, 
parents were informed about matters suph as: Volunteering in the 
classroom, parent meetings—past and forthcoming; services pro- * 
vided by community agencies (TOT- LINE, TEL-MED, Parenting Center 
a^ neighborhood branch of public library, etc.). 

. ' Under "the supervision of Directing Supervisor for Early Childhood 
Education* and-the Project Manager, the Coordinator of Field Set- 
vicfes and her consultant teacher—along with the Coordinator of 
Health Services, the Reading Specialist and other Early Childhood 
- "central* staffs-implemented a series of citywide programs for 
Early Childhood parents. 

Participants were asked to complete redaction sheets after eac^i 
session. (Frequently, however; parents did not indicate in which 
Early Childhood programtU their children were enrolled.) They 
were asked to provide suggestions/comments ai\d to record their 
perceptions of the overall value of the meeting by marking on a 
ten-poifnt' scale, with 1 = "Disappointing/Not Helpful" and 10 - 
"WorthWhile/Very Helpful."., - 

- OA November 13, 1980, 127 Early Childhood ^arent-s (70 with child 
reft in Child Development) representing 53 schools met to learn 
about the projects and to plan parent programs for the year. 

Oft the 40 reaction sheets from parents identified as Child 
Development, the mean rating was 9.3* (of, the possible 10). 

- On January 29, 1981 Child Development parents (N = 22) partici- 
pated in an Early Childhood cityifide program, "What (tuyahoga 
County]] fcooperatdve^ Extension Offers." The mean rating of the 
value of this session was 8.2, based on the reaction sheets of 
18 project parents.. 



- With-R$mily Health Association personnel serving as discussion 
leaders? a total of 39 Child Development parents considered 
^Discipline: Love and Limits" at a workshop held in their 

^cluster ^elementary and secondary schools grouped for desegre- 
*>'ga ) fiR>n) > during February, 1981. Seven, such workshops were held, 
r *" one, iiyeach cluster.' A total of 29 reaction sheets were siib- 

oittea by.parehts who indicated having children in Child Develop 
?. ment;' the mean rating on these discipline workshops was 9.4 
(of a possible TO) . 

- On April 8, 1981 Miss Earnest ine Simmons, Head of Children's 
Services, East Cleveland Public Library, was featured at the 
fifth annual Early Childhood parent reading readiness workshop . 
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Process Objective 3 - (continued) 



' held at the (Main) Cleveland Public Library. Approximately 30 
project parents were among those learning M How to Help Your 
Child Btoom, 0 and 12 marked this project ojx their reaction 
sheets—yielding a mean of 9.9, the highest for any session, 

- In May, 1981 two workshops for parents, at 'schools, were held 
by the Cuyahoga County Cooperative Extension Service, with four 
Child Development parents in thefee groups learning more about 
feeding their families. A total of 28 parents submitted re- 
action sheets, but few indicated in which Early, Childhood 
program(s) their children were participating. The mean rating " 
was 9,3--for all reactions to both programs. 

The high ratings bf these citywide, Earl); Childhood parent pro- 
grams (provided. by Child Development in cooperation with related 
projects) reflected/the staff's success iti meeting needs of child-, 
ren and .families through parent involvement/education. 

. Cooperative efforts of project staff, school staff and community 
fespurces for promoting health* maintenance and social competency 
of project children and their "families were most thoroughly docu- 
mented by supportive services staff. Their statistics were com- 
piled into the. Project Manager's periodic reports to the Directing- 
Supervisor, Compensatory Education Programs. 

- These efforts began with the ^intake process, at which time re- 
ports oT the child's recent physical examination and immuniza-. 
tion we*e required. During the intake interview, the parent (s) 
provided the interviewer (project -teacher or member of suppor- 
tive/"central" staff) with information abo\jt the child 1 s medical 
and social^pistxJty. * ' ^ 

- Throughout the year, project . staff screened L,123 children for 
speech, 929 for hearing and 705 for dentaL problems. As neces- 
sary, referrals (of approximately 235 children/families) were 
made to specialized school personnel and/or community resources. 
Social workers logged 457. observations of 214 children in class- 
rooms, with 109 agency inquiries and 47 referrals. The Speech 
Therapist also com^ftdd diagnostic testing for 57 project 
children. The part-time Dental Coordinator taught 43 project 
classes about care of teeth, and toothbrushes were provided 

for all children. In addition to maintaining contact 
with 25 community agencies and conferring with an average of 
3.6 (general fund) school nurses per week, the part-time Health/ 
Nursing Coordinator also provided direct service to 87. Child 
Development pupils with special needs. 

- Contact among project and. Early Childhood supportive services 
personnel, principals, teachers and noij-project (i.e., general 
fund> supportive services staff were frequent--to icTentify and 
develop strategies for betjter meeting the needs of individual 

-9- 
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. PrQcess Objective 3 - (continued)- 

« > 

children.*' The average number of such contacts per person per 
week was: 11.6 for a sbcial worker, 5.1 for the speech thera- 
' pist and 14.6 for the part-time Health/Nlirsing Coordinator 
(including those with school^nurses .mentioned above) . 

• Supportive services staff reported approximately 675 contacts 
( y v - with Child Development children's families: Slightly over half 

(54.8%) the contact? were made by telephone. Social workers 
) made most (103) of the home visits. . 

. Product Objective 1 : Project participants 1 -mean post r test scores on 
' ' Tests of Basic Experiences [Language, Mathematical will be at least 
, seven NCE units higher than the mean pretest TO BE scores. 

• 9 . Outcome : This objective was clearly attained. 

" . TOBE Language/Mathematics (Level K) were administered by the teach- 
ers to their children included in the sample during the first week 
of November/ 1980 and again early in May, 1981. Raw scores were 
submitted to the evaluator for conversion to NCE-units, based on 
the publisher's only available norms— November prekindergajten for 
the pre-test and November kindergarten for the post-test. Scores 
y on both pre- and post-tests were available for 167- participants, 
(from the original sample of 210) . Results of the analyses have 
been included as Appendix C. • - *' 

- In Language, the pretest mean was 35.1* NCE 1 s; on -the post-, 
test, the mean had increased to 51.6, reflecting an average 
gain of 16.5 NCE units. Based on the norms described above, 
the meaji score moved from 23 %-ile to 53 %-ile. - Furthermore, 
this cknge was statistically significant (p^.OOl). 

y- The pre-test mean in Mathematics was 37.6 NCE's, which in- 
crease! to '46.2 on the post-test. Based on the available 
norms, the mean score moved from 28 %-ile to 43 %-ile. Also, 
this average gain of 8.6 NCE units was statistically signif- 
icant (p<.001). 

The 1980-1981 gains returned to the expected levels, following 
the 1979-1980 drop— presumably attributable to fewer weeks of 
instruction between pre- and post-testing. TOBE results for 
the past five years have been included as Appendix D. 

* • ^ i 

Pro duct Objective 2 : Children will show significantly higher (p< .05) 
levels of self-sufficiency, emotional maturity, social skills and self- 
concept at the end of the year, as compared to project entry, on the 
* ' Levlne-Efzey Rating Sdale (or other Early Childhood appropriate instru- 

ments) ... 

» 

' -io- . _ 
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continue ^ optimize cooperative efforts with staff of other 
projects, %rffctilar (general fund) personnel in the schools and 
community' resources/agencies, to maximize -supportive services 
to children and families. • 
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• Product Objective 2 - (continued) 

. Outcome : This objective was attained, at a level of significance 
beyond that proposed. 

During the first .week, in November and early in May,^teachers rated 
each child in .the. randomly selected, projectwide sample on the 33- 
item Levine-Elzey Preschool Social Competency Scale. Both pre- and 
post-ratings were available for 163 children. * 

The mean gain on Self-sufficiency* (13 items) was .86, on Emotional 
Maturity (9 items)'. 70, and on Social Skills (10 items) .88; the 
gain on the single-item Self-concept factor was .40; the maximum 
rating on any factor was four (4). Additional data have been pre- 
sented in Appendix v E. All gains were statistically significant 
(p<.001). 

The 1980-1981 gains approximated those for 1977-1978. The lower 
mean gains during the two intervening years may have been attribut- 
able to the many disruptions of the school-year schedule (work stop- " 
pages, etc.) and the shorter period of instruction between pre- and 
post-ratings. (See Appendix F for m6an gains from 1977-1978 through 
i980-1981.) 

CONCLUSIONS 

j 

All project objectives for 1980-1981 were attained, with one minor 
exception. Relevant to Process Objective 2, teacher consultants utilized the 

Classroom Observation Checklist at .least one time with only 91.4%— instead of 
the proposed 100%--of the project teachers. The return of student gains in 
both cognitive and affective areas to the proposed levels may have reflected 
the greater continuity in teachers' work with the children throughout this 
past school y£ar (which had brfen diminished in recent, preceding years by 
seriou$ disri^ptignf in the school-year schedule). 
/ • ■ > 

the bas^s of findings reported above and awarenfess of project 
staffing reductions for 1981-1982, the evaluator -recommends that the Child 
Development/ staff: - 1 

focus inservice for teachers on workable procedures for effec- <^ 
tively 'implementing highly individualized instruction for the ^ 
children without the assistance of an educational aide; 

"^ke every effort to utilize the Classroom Observation Check- 
list at least once with each teacher, preferably during the 
first semester; • 
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APPENDIX A 



CHILD DEVELOPMENT 



Schools Served: 1980-1981 



Alfred A. Benesch 
Anton Grdina 
Bolton 

Buckeye-Woodland 
Captain Arthur Roth 

Case 

Charles H. Lake 
Charles Orr 
Giesterfield 
Daniel E. Morgan 

East High 
East Clark 
East Madison, 
Giddings 
Glenville High 

Hazeldell 

Henry W. Longfellow 
Iowa-Maple 
John W. Raper 
Joseph F. Landis* 



\ 



Louis Pasteur 
Margaret A. Ireland 
Marion-Sterling 
Mary B. Martin 
Mary M. # Bethune 

Miles Standish, 
Mount Pleasant 
Orchard 
Paul L. Dunbar 
Paul Revere 

Scranton 
Stephen E. Howe 
Tremont j 
Wade Park 
Woodland Hilfs 



* 
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APPENDIX B 

Cleveland Public Schools" 
Division of Early Childhood education 

OBSERVATION CHECKLIST J 



Teacher 

School 



Room 



Observer 

Circle? 



Session: A.M. 



P,h\ 



CO Kft 



I, ENVIRONMENT 
A. PHYSICAL 



[ j Effective ust of physical plant 



| | Centars astabl ished, labaled and wall organized (list thoseTn usa)' 



j [ Safaty precautions taken 



Observation Check! 1st (continued) 

A. PHYSICAL (continued) 
^> | [ Art Center near water If possible 



f~[ Block Canter coded (accord Ins to size and shape of blocks) ? 



| j Listening Center with appropriate audio-visual equipment 



Creative work (children's) attractively displayed 



,er|c 



|"~] Hw*b*r and alphabet charts placed In appropriate eantars at children's ay* level 

-13- 
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Observation Checklist (continued) 

\ - 



APPENDIX B {continued) 



i A. EHVSICAfc (continued) 

( ] lorn log environment seems flexible and under control 



| | .The noise level imrs appropriate for the activities In progress 



\ RECOMMENDATIONS 

-i- : l. 




t. MATERIALS _ 

| | Children obtain, set-up and put material t away appropriately 



Observation Checklist (continued) 

1 -\ 



9. HCTCTIAU (eontlmiad) 



Materials are appropriately prog r an id for centers that wllli 
| | develop both fine/gross motor skills 

□encouraee creativity 
art* blocks, sand/weter 



[ | respond 



to various developmental levels 



ERIC 



|*"~| effective organization of Materials by the teacher 

j | appropriate containers 

|"7| controls 

' £J completc'scts 2 1 
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Observation Checklist (continued) 



APPENDIX B (continued) 



MATERIALS (continued) 



RECOMMENDATIONS 




H. CURRICULUM IMPLEMENTATION * 

A. KECOKDS/tO 8E 0ISCUSSEO AND SHARED 

_ ' V 

l \ . Evldsnce of continuous assessment of cbNdren 

• cm tors progr a m ed « 

• center sheets 

• individual Instruction 




Observation Checklist (continued) , 1 

t 

** ^ 

I. MAW INC 

* PI - Mdoneo of current dslly plans with stated goals and objectives for targeted children 



\ } /Evidence of designated respons I bf 1 1t las for: 
[ j | .taachor assistant • 



D 



voluntaers 



RECOMHENDAT I ONS 



observation checklist (continue) APPENDIX Bf (continued) 

C. SCHEDUUNC • 



Minutes In se I f -selected and Individual Instructional activities 



Minutes In smalt group, teacher Initiated activity Lotto, Peabody, Haemlllan, etc. 



Minutes In total group 



RECOMMENDATIONS 




Observation Checklist (continued) 



IHSTMJCTIONAt ACTIVITIES 



□ ^ 



scusslon Center - (sharing Ideas* demonstration! end evaluation sessions) 



£ |^ j Library * (browsing and reading and being read 



to) 



I I tanquege - (gaeies and activities for developing language ability and reading readiness 
I— ' , concepts). ? ** 



□ Math Center - (games and activities for Independent and smalt group Investigation of 
concepts) * 



P*] |cjencf Center - (sensory experiences and the discovery of the world^and nature) 



observation checklist (continued) APPENDIX" B (continued-) 

p, /instructional ACTivrnes. (continued) 

————— , 

I I Special Concept Area - (mult I-sensory materials dliplayed which relates specifically to 
l~J the concept In focus) 



Wanlpulatlve Center - (learning through exploration and experimentation) 

\ * 

□ Stock Center - (sensory and motor stimuli' through phy steel activity and Imaginative 
expression)' 



|~j Art Center - (self-expression with an assortment of materials) 



Qj Housekeeping ~- (self-expression and dramatization) 



Observation Checklist (continued) 



C. IHD1VIDUAI - SMALL CROUP 



% ^ rn Small group .and Individual children are permitted to operate In learning centers for 
I — I ' long periods of uninterrupted time * 



| | Children's activities are adapted to meet their Individual needs and attention spans 



□ Adults circulate among children Instructing them, asking questions end'glvtng, Individual 
.attention ~ 



Children receive Individual Instruction from: 



{ | teacher 

teacher ess I stent 
<f another adult 
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Observation Checklist (continued) 



APPENDIX 6* Cccmtit\ued) 



C. IHPtVlQUAL - SMALL GROUP (continued) 

Children receive well group Instruction fro*: 



□ 
□ 



teecher 

teacher assistant 



| I another adult 

• ■ y : 

h • \ 

pi Children receive Instruction In lenguoge development (Lotto, ^f^t Hec*U1* 



□ 



Children are encouregec to solve probl* 



□ 



Children aove around the rooe es appropriate to activities In progress 



Observation Checklist (continue 



r. INDIVIDUAL - SHALL CROUP (continued) 




r\ TOTAL CROUP 



I j Activity stimulated Interest of ell or post of the group. 



Q Alternative quiet activities are provided for those children not able to cope 



4 



Mult* ara participating In tha actlvltla* 
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Observation Checklist (continued) . APPENDIX B (continued) 



r. T0TA1, GROUP (cpnt Inued) 



Total group activity la composed of: 



* » 




III. HWAH RELATfrONS - 6UI0AHCE 



[ | Adults appaar to work well togathar 



Adults usa wall modulated volcas In tha classroom 



* Observation Checklist (continued) 



III. HUMAN RELATIONS -*tuiDAHCE (continued) 



I I Adults deal with "appropriate behavior 1 * quietly and personally 

\ . 



□ Adults operational style Is In keeping with the philosophy of the Division of Early 
Childhood 

7 '■ • 



[ | ' Children help each other 



| j Children respond to classroom Units 



i * ax 
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APPENDIX C 

CHILD DEVELOPMENT: 1080-1981 

TESTS OF BASIC EXPERIENCES, LEVEL K 
(N = 167) 



TEST 



PRE- (10/80) 



POST- (5/81) 



MEAN* S.D. %-ILE** MEAN* S.D. %-ILE** 



MEAN 
CHANGE 



SIGNIF. 
LEVEL 



Language 35.1 14.9 23 

Mathematics 37.6 15.5 28 



51.6. 21.8 53 



46.2 *19.2 43f; 



i6.5 10.23 p<.001 
8^.6 5.69 p<.001 



♦Means are expressed in NCE units based on national norms, described below. 
♦♦Percentiles are national norms: prekindergarten for the pre- test, kindergarten for 
the post- test. 



27 



ERIC 



APPENDIX D 



CHILD DEVELOPMENT 

NCE GA\NS ON TESTS OF BASIC EXPERIENCES 
1976 - 1981 t 



y 



18 
17 
16 
15 
14 
13 
12 
11 
10 
9 

5 7 

03 

U 6 - 
2 

5 ■■ 
c 4 
3 - 
2 

1 

Year 76-77 




-PROPOSED GAIN. 



/ 



+ 



4- 



N 



201 



77-78 
200 



78-79 
109 



79-80 
204 



80-81 
167 



♦NCE units were based on publisher's national norms: pre-kindergarten 
for the pre- test, kindergarten for the post- test. Gains of 7 NCE' s 
were proposed. 
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APPENDIX ,E 
. CHILD DEVELOPMENT: 1980-1981 t > 

LEVINE-ELZEY PRESCHOOL SOCIAL COMPETENCY SCALE 

. (N «= '16.1) * 



r 

FACTOR ' , 

o 


' PRE- 
MEAN 


j 

{10/80) 

S.D. 


POST- 
MEAN 


(5/81) 
S.D. 


t 

e 


SIGNIF. 
LEVEL 


Self-sufficiency 


" 2.41 


.59 


3.27 


.50 


20.59 


p<.001 


Emotional Maturity 


' 2.63 


.6r 


3.33 ** 


.57 


14.L8-J 


p<.001 


Social Skills « 


2.36 


.61 • 


3.24 


.52 


. 19.75 


p< .001 


Self- concept 


2.785 


.51 


3.18 


.53 


8.18 


p<.001 






a 


* 
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APPENDIX F 

| CHILD DEVELOPMENT 

MEAN GAINS ON LEVINE-ELZEY PRESCHOOL SOCIAL COMPETENCY .SCALE : 1977-1981 



?- 



r 




** ' 

NOTE': N=203 (1977-78), 174 (1978-79), 203 (1979-80), 161 '(1980-81) . 
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CHILDREN IN RESIDENTIAL SCHOOLS 
1980-31 Title I Evaluation 



PURPOSE AND OVERVIEW^ * - 

Children residing in institutions serving orphaned, neglected and 
delinquent children are automatically eligible for Title services. The Child- 
ren in Residential Schools project provides additional instructional and sup- 
portive services to such children beyond that which is normally available td 
them through their on-grounds schools or in the public or non-public schools 
they attend during the day. At the Cuyahoga qouftty Youth Development Center, 
the Cleveland Public Schools operates an on-groundk. formal educational facil- 
ity, Harry L. Eastman School. At/Harry L. ^Eastman, students are provided in- 
dividualized and smal>| gTOup^utoVing in school subjects and^classes for cor- 
rective reading instruction. At nine other institutions whi^^intain their 
own on-grounds schools or whose students attend nearby public ormS^ublicjj* 
'scl(ool/, the project provides after-school tutoring in school subjects in whH:h 
stu»ttits are having difficulty. r Other educational supports such as school sup- 
-plies^fliid field trips are also provided. M 

SERVICE SUMMARY ' 

— * 

Pupils Served : S94 Grades Served : 1-12 Years in Operation :^14 

(School' year and summer) , ^\ 

Schools* l school and - Staffing : 17 Teacher-Tutors 

9 residential institutions (7 FT, 10 PT) 

Total Title I Expenditures : $250,054 Per Pupil Cost : $421 

SUNMARY . OF FINDINGS • i 

i" 

The evaluation data indicated that at Harry L. Eastman School, pro- 
ject services were delivered essentially as proposed. Teacher-tutors provided 
extra individualized end small group ^instruct ion in "career education, health 
skills, art, physical educatiort and mathematics- Students with reading weak- - 
nesses were provided daily corrective reading classes by/ two reading .specialists. 
'Reading scores showed the proposed degree of improvement when the scores for 
all grade levels were combine*!, but the statistical analysis cast doubt on 
whether the gains demonstrated by the students were reliable ones.* 

Although after school tutoring service was proposed in nine other ' 
residential institutions, the service was actual ly ^provided , in only four and 
at reduced levels. iTie jxroject* manager pointed out that the project has little 
control over the degree ( tb^Which the institutions take advantage of the re- 
sources offered through the project. 

• . • .. ' y m - ■ " 



r * 
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OBJECTIVES AND OUTCOMES 



Process Obje.ctive,l - Institutions Refceiving Tutorial Sendees : 
Teacher-tutor personnel delivering the following amounts of services 
will be assigned to each of the mine institutions: 



1. Cleveland Christian Home 2 

2. Ohio Boys' Town 1 

3. The JoMf Home of .Children's Services. 1 

4. Metz^Cum Children's Center 2 

5. The 4Ppe Network 1 
6* Augustine Society Group ^onie 1 

7. t Looking Glass 1 

8. Open Doors for Youth t 1 

9. Salvation Army Group Home 1 



PT (67% FTE) 

PT (50% FTE) 

PJ (50%, FTE) 

PT (67% FTE) 

PT (10% FTE) 

PT (16% FTE) 

PT (16% FTE) 

PT (10% FTE) 

PT (V6% FTE) 



. Outcome : An examination of project records showed that this objec- i 
tive was only partially achieved. Only four of the nine institutions 
' used the available Title I monies for tutoring services, and only one 
of the four delivered this service 0 at «FTE levels specified in the 
objective. Table I shows the Institutions providing tutoring service 
and the amount of service provided. w , 

• Table Is " 

Staffing Pattern and Level of Tutoring Service at Institutions 
Providing Tutoring to Students 



erJc 



Ins t itut ionKProvi'ding 
Tutoring Service 


Number of Tutors 


.Full -Time Equivalency 


Proposed £ 


Actual 


Proposed 


Actual 


Cleveland Christian Home* 
The Jones Home of Children's SvcsT 
Metzeniaum Children's Center 
Augustine Society Group Home 


~ i 

2 PT . 
1 PT 
v 2 PT 
1 PT 

« 


3 PT 
2 PT 
3' PT 
1 PT 


.67 
.50 
.67 
.16 y 


.59 
, .63 
. .35 

.02 



Queried about the lower than expected level of tutoring service offered* 
'at the institutions, the project manager pointed out that .Title I 
monies are allocated by the state to each of the institutions and that 
decisions about how that money., is spent rest wi^h the institution- staff 
(within the^ limits imposed* by. Title I guidelines). The project office 
can 'make recommendations, appoint staff at the institution's request ^ 
and insure „that Title I regulations are being followed, but it cannot 
impose staff, materials or other services. - The project manager re- 
ported" that the'five institutions not providing tutoring service 
did not 'respond to requests for direction regarding the appoint- 
ment of tutoring staff. He also noted that 1980-81 was the first 
year iri'the project for four of the five. ^ 

The project manager reported that the teacher- tutors at Metzenbaum 
Children's Center and the Augustine Society Group Home were teachers 
in Cleveland Public Schools who tutored at. the institutions after hours. 



-28- 



33 



\ 



. Process Objective 1/ - (continued) 



f 

At: the Cleveland Christian % {iome and the Jones Home the teacher-tutors 
were teachers working at the ^institutions 1 own on-grounds schools who 
provided tuforing service after-hours using Title I resources. 



Process : Objective 2 - Institutions Receiving Tutorial Services : Pupils 
'will identified and referred cooperatively for tutorial help by th^ 
institutional staff and the students 1 regular classroom teachers. • 

. Outcome : This objective was achieved. The* project manager reported 
referrals for tutoring service are generally made in three ways: 

1. A teacher in the institution's own on-grounds school may identify i 
student as- in need of extra help and refer him,to the v tutor serv- 
ing that institution. (Often, the referring teacher and the tutor 
are the same person.) ^ 

2. A teacher in the public school attended by the student may iden- 
tify him as in need of tutoring and refer him through the social 
worker serving v the institution. If the tutor serving the in- 
stitution works during the day in the same public school as the 
referring teacher, students may be referred to the tutor directly. 

3. A student who desires extra* help* may request it directly. 

The projectJemphasizes providing assistance to institutionalized stu- 
- dents in th<T>areas of reading, and mathematics, although help is given 
as needed in other school subjects? Service is provided in the form- 
of individualized or small-group tutoring sessions held in the insti- 
tution after school hours. The project also provides monies for other 
educational supports, such as field trips,- supplies and instructional 
materials and equipment. - / 

Examination of records submitted by the teacher-tutors, documented the v 
number of students who. received tutoring and other services at each 
^ of the institutions. These data' are presented in Table 2. 

The table shows that no services of any kin<J were delivered Jto two of 
the. institutions designated to receive them, Ohio Boys Town and Look- 
ing Glass. The project manager reported that the staff of Ohio Boys 
Town did not respond to repeated requests for direction regarding 
staffing and supplies ;needs. At Looking Glass, some instructional • 
equipment -was purchased, but delivered too }ate for use with students 
during 1980-81. The remaining seven institutions provided tutoring . 
and/or other educational support to their students. 
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Process Objective 2 - (continued) 



Table 2 



^Numbers of Stu 
• at Each of 

i 


jlents Receiving Tutoring and Other Services 
[the Institutions Served by the Project 

' / 


Institution / 


Students 
Tutored 


Students Receiving Tutoring or 
Other Educational Services* 


- . ^ , -r- 

Cleveland Christian Home 
Ohio Boys Town • 

The Jones Home of Children's Svcs. 

Metzenbaum Children's Center 

The Agape Network 

Augustine Society*Group Home 

Looking Glass 

Open Doors for Youth 

Salvation" Army Group Home 

TOTAL % 


34 

0 ' 
42 -P 
35. 

0 ' 
24 

0 ' 

0 

0 

135 


34 

- 123 ' 

V 11 

86 
0 
36 

\ ■ Jl ' 
' ' ' 371 

* 



♦Includes field trips, purchase of equipment, supplies, instruct iqnal 
materials, etc* * 

Process Objective 3 - (fryah^^bWy Youth Development Center : Teacher - 
tutors will assist students by ptoviding infoxmaticffi relative to improve- 
ment of grades : in subject areas of weakness and attitude toward school. 

. Outcome: Project record? indicate that this objective was achieved. 
Students attending the Harry L. Eastman School at the Cuyahoga County 
Youth Development Center were, provided with information and instruc- 
tion in a variety of subject areas. This instruction was Over and 
above tiiat normally provided the institution by the Cleveland Public * 

was' delivered hV five full-time teacher-tutors working 
with individuatfcvand small groups. Table 3 shows the subjects and the 
numbers of students^^cei^ng information in each. 

Table 3 * 

Title I Supported Instruct ional. Area|* and Numbers 
of Students Served in Each' at Harry L. Eastman School 



Sub j ect 



Number of Students* 



Career Education 
Physical Education 
Health Skills and Careers 
Arts and Crafts Skills 
Mathematics Skills 



223 
68 
85 

< I 9 

. 75 



♦Duplicated counts 



-30- 35 



ERIC- . - 



Process Objective 4 - CuyaKbgy County Youth* Development Center : Cor- 
rective reading classes, sp^ffch therapy and psychological services 
will be provided as needed*© students with reading, speech or ^psy- 
chological problems. / 



Outcome : Project 'records indicate that this objective. was achieved. 
The records show "that 207 students >were evaluated for reading. defi- 
ciency by the Title I reading specialists at Harry ,\L. Eastman School. 
Of th ese students, 140 were selected to receive instruction daily in 
formal corrective reading classes. These classes were ■ taught by two- 
full-time Title I reading "specialists who used a Variety o,f \nstru-' 
>tional materials purchased with Title I monies. In addition^ 97 
students received instruction in English-reading classes by 'teacher- 
tutors. 4 * 

The project budget ^contained monies to support speech therapy and 
psychological services if those were needed at levels beyond those 
normally. provided the institution by the Cleveland Public Schools 
and the county. Project* records indicated that extra speech' and 
psychological services were not required in 1980-81. ' # 



Product Objective 1 - Cuyahoga County Youtly Development Center : For » 
students receiving the equivalent of at least one semester's se t rvice 
at the Cuyahoga County Youth Development Center,/ a gain of two NCE units 
will be observed from the comparison of pre tQ post performance^ as mea- 
sured by the Comprehension subtest of the Stanford' Diagnostic Reading 
Test. * 

.- ^Outcome : The data indicate that this objective was^technically 
o achieved, but tfiat the gains demonstrated' may not be reliable. 

Project records show that 207 students attending the Harry L. Eastman 
School at the Cuyahoga County Youth Development Center were £dminis-> 
'tered the Comprehension' subtests of the Stanford Diagnostic .Reading 
* Test (Brown Level, Form A) shortly after entry. Students were adc 
ministefred the same tests again just before leaving, the institution 
or at the end of the school year. Because of the entry and leaving 
patterns at the institution, both pre and post data were available 
for* only- 70 students who received instruction for at least the equi-- 
valent of one semester. 

^ o • r 
The analysis of the test data showed that the average pre-po%t gain * 
in Total Comprehension for all grade levels combined was 2.3 
NCE units, which me^ts the criteria set in the objective. However, 
the size of the wrfn closely approached, but did not reach statis- 
tical significance as determined by a t>test for repeated measu^e^. 
This means there is some doubt as to the reliability of the gain. 
(See Appendix B for the results of statistical tests.) Table 4 
presents the pre and post test results by grade. 
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Table 4 



" ) ~ 

Pre and Post Test Results by Grade Level of Students at 
Harry L. Eastman ScRool (Stanford Diagnostic Reading Test, 
Total Comprehension, Brown Level) 

s 





' Grade 

r~ 


N 


Pre mean 


Post mean 
NCE * 


Mean NCE 
Gain 




7 


1.2 


46.2 


" -4T.0 


+ .8 




8 


19 


. 37.7 


43.0 


+ 5.3 




9 


20 


30.?^ 


31.9 


+ 1.7 


4 


10 


12 


32.8 


33.3 


+ .5 0 




11 


6 • 


25.2 


28.8 / 


+ 3.6 




12 


.1 


50.0 ' 


35.0 


-15.0 


V 


TOTAL 


70 


35.3 


, , 37 - 6 


+ 2.3 



*See Appendix C for an explanation of which norms tables were used ia the 
derivation of the NCE scores* 

\ 

The table shows that although the object jj^. criterion of an average 
gain of at le^st 2 NCEs was achieved overall, this result was due 
entirely to the performance at grades 8 and 11. None of the gains 
at the individual grade levels was statistically significant. The 
* Title I reading specialists reported extreme difficulty in motivating 
the^students to take the reading tests seriously. 

The objective ^criterion was stated ^n terms, of NCE units. To help 
the reader seeYtotr the project students performed relative to other 
students the same age, Table S presents the percentile ranks Qf their 
average I<CE scopes based on national norms. 

The percentile data show that most of the students served by? the pro- 
ject rank in the lower score ranges of Students nationally, both be- 
fore and after participation. 
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Table S 



Percentile Ranks of Average Pre ancl Post Scores Obtained 
on the ^Stanford Diagnostic Reading Test by Students at 
Harry L. Eastman School " 



N 


Pre 
Percentile 


Post 
Percentile 


12 


43 


44 


19 


28 


37 


20 


17 


20 


12 


21 


21 


6 


12 




1 


SO 


, . 24 ^ 



Grade 



7 
8 
9 
10 
11 
»i!2 
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CONC LUSIONS ' - 

The evaluation data gathered for the 1980-81 operations of the Children 
in Residential Schools project indicated that project services were delivered 
essentially as proposed to the Harry L. Eastman School at the Cuyahoga County 
Youth Development Center. Teacher-tutors provided instruction beyond that 
normally offered at 'the school iij a variety of subjects including career ed- 
ucation, health skills, physical education, art and mathematics. In addition, 
* corrective reading classes were provided daily for students identified as 
deficient in reading skills. ; Reading Conjprehension scores obtained on stu- 
dents at Harry L. Eastman School showed that the proposed average pre-post 
gain of at least 2 NCE points was achieved, but the statistical analysis 
indicated that this gain may not be reliable. 

In addition to the services offered at Harry L. Eastman, after school 
tutoring services in school subjects were proposed for students in nine other 
institutions, but the data showed that the service was provided in only four 
of the nine. In only one of these four was tutoring provided at the levels 
specified in the proposal. It was pointed out that the project ^office does 
not have direct control over the implementation of project services in 
institutions and that four of the five institutions not providing tutoi 
t service were in the project for the first time in 1980-81. 




In summary, three of the four process objectives we^e attained *anc 
was partically attained. The project objective was technfc-aLljy attaint „ 
but there is some doubt as to the reliability of the result. Spieweakness 
was evident in insuring that services were delivered a^V^ir^d^quate level 
to institutions scheduled for tutoring services, but in general the project 
operated as proposed. 

It is recommended that steps taken to insure that 4 institutions are fully 
aware of the resources available to them under the Children in Residential 
Schools project and that they are Encouraged to make the fullest use possible 
of them. In addition, it is recommended that alternatives to the Stanford 

0 

-33- 



38 



—Diagnostic Reading Test be examined for use in measuring gains in reading 
achievement. An instrument is needed that provides both beginning of year 
and end of year norms at all grade Revels tested. 



r 



K 



i 



\ 
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APPENDIX A 

Institutions Served by Children in 
Resident^al^chools Project in 1980-81 * 

Cuyahoga County Youth Development Center 
Cleveland Christian Home 
The Jones Home 
Looking Glass 

Metzenbaum Children's Center 
Open Doors for Youth 
Ohio Boys Town Inc. 
Salvation Army Group Home 
The Agape Network- 
Augustine Society Group Home^ 
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APPENDIX B. 



1 Means, Standard Deviations and results of t_ - Tests on StShford Diagnostic Reading Test 
(Brown Level, Form A) Total Comprehension NCE" Scores of Students in Grade 7 - 12 at 

Harry L. Eastmap School 



• > 

Statistic 


•7 

/ 


8 


9 


Grade 

10 


• 

11 


12 


Total 


Number of Students 


12 


19 


20 


12, 


6 


1 


70 


Pre Mean NCE 


46. 17 


37.68 • 


30.20 


32.83 


25.17 


50.00 


35.27 


Post Mean NCE. 


47.00 


43.00*' 


. 31.95 


33.33 


28.83 


35.00 


37.54 


m Pre.S.D. 


15.30 


19.47 


13.17 


24.47 


22.03 


0.00 


18.90 


Post S.D. 


13.32 


22.44 


• 15.95 


26.02 


26.09 


0.00 


20.73 


0 Mean NCE £frin 


.83 


5.31 


, 1.75 


.50 


3.67 


-15.00 


. 2.27 


f Gain S.D. 


3.33 


• ' 14.31 


9.40 


7.80 


4.46 


0.00 


9.93 


t 


.86 

ft "***• 


• 1.62 


.83 


.22 


2.01 




1.91 


df V 

> 


11 


18 


19 


11 


c 




-it 


E 


>.05 • 


, >-05 


>.0S 




>.05 




>.05 


E 

\ 

/ 






* 

4 


5 

* * 

** 




c 

c 
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APPENDIX C 



Norms Used for Converting Total Comprehension Raw Scores to 
NCE Scores on the Stanford Diagnostic Reading Test (Brown Level, 
Form A) Administered to Students in Grades 7 - 12 at 
Harry L. Eastman School 



In order to measure the amoi^nt of growth in reading skill most 
accurately, the pre and post raw scores obtained on the test should be con- 
verted to NCE scores using the norms tables most appropriate to the times 
of year the test was administered. Where tables were available, pre scores 
were converted using beginning of year norms and post scores were converted 
using end of year norms. At grades where only beginning of year norms were^ 
available, the pre scores were converted using the beginning o£ ^ear norms 
for that grade level and the post scores were converted using the beginning 
of year norms*for the next higher grade level. The table below shows which 
norms were used for interpreting the scores at each grade levei tested. (At 
all grade levels, national norms were used.) 



Grade Tested 


Pretest 


Posttest 
Norms 


7 


Grade 7 
Beginning of Year 


Grade 7 r ' 
End of Year 


8 


Griade 8 
Beginning of Year 


Grade 8 
End of Year - 


9 


; Grade 9 
Beginning of Year 


ft Grade 9 
End of Year 


10 


Grade 10 
Beginning of Year 


Grade 11 
Beginning of Year 


11 , 


Grade' 11 
Beginning of Year* ' 


Grade 12 
Beginning of year 




(jrade 12 
Beginning of Year 


Grade 13 
Beginning of Year • 
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CLEVELAND FUNDAMENTAL SCHOOL BASIC SKILLS REINFORCEMENT PROJECT 



1980-81 Title I Evaluation- 



PURPOSE AND OVERVIEW 

The purpose of the project is tp provide specialized small-group 
instruction for pupils attending The Cleveland Fundamental School who are 
experiencing difficulty in mathematics or reading. Pupils eligible for 
thife service ifeceive remedial assistance^from special reading and mathe- 
matics teachers within the confines of a special resource cqnter designed 
for this intensive instruction. Each day, the student^leave their 
• regular classrooms and participate in carefully plannedSactivities, 
individual or small-group, for forty minutes. The instruction provided by 
the project is in addition to the jeading and mathematics instruction the 
students receive in their, regular classroom?. 

SERVICE SUMMARY • / - „ \ 

Pupils Served; 139 Grades Served: K - 6 Years in Operation: 2 

Schools : 1 public Staffing: 1 Project Manager, PT 

2 Reading Consultant Teachers, FT 
* 1 Math Consultant, FT 

« Total Title I Expenditures: $99,431*, Per-Pupil Cost: $715 

SUMMARY OF FINDINGS 

f In its second year of operation, the Cleveland Fundamental School 
Basic Skills Reinforcement Project has provided a service tfrat addresses 
and meets the remedial needs of students and is perceived as valuable by the 
dlAssroom teachers of these students. Students in grades two through six 
were pre-tested in the fall and post-tested in the spring. Students made 
greater gains than were expefcted in Reading arid in Math* at aU grade levels. 
Regular classroom teachers were provided with 2 hours of inservice about the 
program; vthey rated the quality of inservice very high. 



OBJECTIVES AND OUTCOMES r ' * 



. Objective 1: The' reading skills of participating pupils in grades two 
through six will improve as evidenced by an increase of at least four 
NCE units on standardized reading tests -administered prior -to and fol- 
lowing project participation. " - 

. Outcome : Objective 1 was attained . The Comprehensive Test of Basic 
Skills (CTBS) Reading Comprehension sub-test yjas administered to all 
participating pupils in grades vtwo through six on a pre-post basis 
the fall of 198a and the spring) of 1981. m Pre NCE units were derived 
from fall norms and post NCE'units were derived from spring norms. 
The objective criterion was met with eyer^ grade level. NCE unit 
gain by grade levef is presented in the following table. 



NCE UNIT GAIN 
Reading" Comprehension 

i & 



Grade 


n 

pupils 


Level and Form 
^ of Test 


.Pre 
Test 
Date 


Post 
Test 
Date 


Treatment 
Time . 
(Weeks) 


t 

i 

Average Pre/Post NCE 
Difference 


2 

i 

4 

5 

6 - 
Total 


^6 
12 
17 
15 
13 

63 


Level C, Form S 
Level 1, Form S 
Level 2, Form S 
Level 2, Form T 
Level 2, Form S 


10/80 
10/80 
9/80 
9/80 
9/80 


5/81 
5/81 
4/81 
5/81 
5/81 


28 - 
* 28 
29 
31 
32, 

■ /., 


+ 20.67 
+ 8.16 
+ 9.00 . , 
+ * *.07 
+ , 9.92' 



The objective criterion standard was stated in terms of NCE units. 
The. following table - will enable the reader to see the pupil standing repre- 
sented by percentile ranks, based on national norms and relative to students 
of the same age. 



PERCENTILE RANK 
Reading Comprehension 



Grade 


Pre-Test 


Post -Test 


2 


27 


64- 


3 


27 


40 


• 4 


17 


29 


5 


16 


27. 


6 


17 


• * 31 


* 

* 


-42-. 


46 



v 



It may^be concluded, from the percentile data, that the students 
served by this project in reading started at very low percentile rankings 
and ©ade marked gains after treatment. The growth is most noteworthy for 
gfade 2 pupils. 

<r. Objective 2 : The mathematics skills df participating pupils in grades 
two through six will improve as evidenced by an increase of at least 
four NCE units on standardized mathematics tests. 

7- Outcome : Abjective 2-was attained . All participating pupils in 
grades two through six completed all math subtests of the CTBS on a 
pre-post basis in the fall of 1980 and the spring of 1981. Pre NCE 
units were derived from fall norms" and post NCE units were derived 
from spring norms. The increase in NCE units on the tests is shown 
in the following table. , 



NCE UNIT GAIN 
Mathematics Total Score 



Grade 


n 

pupils 


Level, and Form 
of Test 


Pre 

Test 

Date 


Post 
Test 
Date 


Treatment 
Time 
(Weeks) 


Average Pre/Post NCE' 
Difference 


2 


6 " 


•Level C, Fdrm S 


10/80 


5/81 


29 


+ 


.18.00 


3 


6 


Level 1, Form S 


11/80 


4/81 


20 


+ 


31.17 


4 


7 


Level 2, Form S 


9/80 


5/81 


30 


+ 


12.43 


5 


11 


Level 2,, Form T 


9/80 


4/81 


29. 


+ 


20.73 


6 


9 


Level 2, Form S 


9/80 


3/81 


25 


♦ 


16.34 



Total 39 



Pupil standing in Math is presented, in the following table, by, 
the use of percentile ranks. y 



PERCENTILE RANK 
Mathematics 



Grade. 


Pre-Test 


Post-Test 


2 


13 


38 


3 


6 


45 


4 


•17 


36 


5 


. 12 


41 


6 


17 


43 



Pupils pre-tested, before treatment, ranked very low in terms of 6 
percentiles. All grades made substantial gains in percentile ranks following 
treatment, especially grades three ^nd five. 
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Objective 3: Project Staff will maintain communication with classroom 
teachers throughout the project year to facilitate improvement ip reading 
and mathematics as evidenced by 70 percent of participating teachers pro- 
viding a positive rating of usefulness of information/inservice resulting 
from their contact with project staff. ^ . 

. Outcome: Objective 3 was achieved. A teacher opinionnaire was used 
to measure classroom teachers 1 reactions to the usefulness of service, 
information, and iriservice provided by Title I staff. A copy of the 
instrument may be found in Appendix A. Teachers were asked to use a 
five-point scale (5-most positive, l=most negative) to rate Title I 
services along the following dimensions: techniques used and tne 
success of service, level of communication between classroom teacher 
and consultant teacher regarding pupils seyved, and value or 
practicality of inservice sessions provided by Title I staff. Four- 
teen of the 'twenty teachers or 70% completed the survey. 

Of the teachers returning surv<y&s, 100% provided positive ratings 
(i.e., an'average rating of 3 or above). The f&llowing table shows 
.that, on a scale from 1-5 (five representing the most positive re- 
sponses), The Title I teachers wer? viewed as providing very useful 
services . 



. Classroom Teacher Reaction 
• to Project Service 



it 



Average Rating of 
Service 



Grade Level 


tea&hefrs 


Reading 


Math 


Primary 


« 


<* 

4.85 


.4.84\ 


Upper 


7 ' 


4.80 


4.83 — ' 



ADDITIONAL FINDINGS J 

Additional information related to project operations is summarized * 
be Ibw. The information was derived from examination of project records" and 
observation of project operations. 

• s - 

. Pupils recommended by the regular classroom teacher for participation 
in the project had to meet the following selection criteria: perfor- 
^.mance at or b^low the 33rd percentile o%the reading comprehension 
-and/or any math, subtest of the folloiBSng^tests: the Metropolitan 
Readiness Test (grade one), Stanford Diagnostic Reading or Math Tests 
{grades two and three) , or the CTBS from the previous year (grades four- 

. Each , (Consultant Tiacher serviced approximately fifty pupils each day . 
(ranges 47-55). ■ During each of the seven for ty-minute, periods per 
day, an average of seven pupils were served (range * 3c9). 'The sites 
for instruction were in the Title I Resource Room apart from the pupils* 
regular classroom. 



♦ 



The Title I Staff planned and implemented 2- hours ofinservice', as pro- 
posed, for the classroom teachers. One* session was devoted to the* 
Reading service and the other session focused. on Math. At each work- 
shop, the Title I "teachers provided these "how-to's": 1) enriching 
lesson plans, 2) reinforcing skills, and 3) checking -out materials from 
the Titl-^T\Resource Room. 



CONCLUSIONS 

* In its second year of operation, the Cleveland Fundamental School 

•Basic Skills Reinforcement Project has provided a service that addresses the 
remedial nqeds of students and is perceived as valuable by the classroom teach- 
ers of * these students. The project has achieved all three of its proposed ob- 
jectives. Tespdata reveal, that the pupils served by this project, .though still 
in relativel)^bw percentile ranks, made substantial gains after treatment, The 
classroom teachers rated this program highly, assigning an average rating of 
4.8 on a scale of 5. 
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APPENDIX A 
TEACHER' REACTION SHEET 
BASIC SKILLS REINFORCEMENT PROJECT 
TITLE I 
FUNDAMENTAL EDUCATION CENTER 



Directions: Please give your impressions of the usefulness of service /information, 
" and inservice resulting from your contact with the Title I -project 

staff (Reading: Mrs. Victory - grades 1-3, Ms. Stephens -"grades 

4-6; Math: Mrs. West). Circle the number along each continuum which 
* most closely represents your feelings concerning- each item. Note 

that a "5" represents the most positive response, while a "1" re- 

presents the most negative response. 



X RATING 



NUMBER RESPONDING 
IN •EACH CATEGORY 



Grade 



SERVICE TO STUDENTS 



5 4 3 2 1 



5.0 
5.0 

S.O 
5.0 
4.86 
4.86 



4.79 
4.79 

4.71 
4.71 

4.79 
4.79 



4.86 
4.86 

4.71 
4.71 

4.71 
4.7-1 

4.86 
4.86 



Reading 
Math • 

Reading- 
Math 
Reading 
Math ' 



Reading 
Math 

Reading 
Mat^h 

Reading 
Hath 



Reading 
Math 

Reading 
Math " 

Reading 
Math 

Reading 
Math 



PURPOSE FOR TREATMENT WAS 
CLEAR 

METHODOLOGY FOR TREATMENT WAS 
CLEAR " 

SERVICE BENEFICIAL 



Reading 14 
Math 14 

Reading 14 
Math 14 

Reading 12 2 
Hath 12 2 y 



- • INFORMATION SHA3ED WITH YOU RE: STUDENTS 



NUMBER OF CONTACTS VA5 ADE- 
QUATE " ; " r . ^ 

INFORMATION SHARED HAS VALU- 
ABLE 



Reading 11 3 
Mith 11 "3 

Reading 11 Z! i : m 



WAS ABLE TQ ACT ON INFORMATION Reading 12 li X 
SHARED Hath - 12 1 r 

CROUP INSERVICE SESSION'S 



sessions were worthwhile 

new knowledge acquired at 
Sessions 



Reading \% 2 
M*th^ , 12 2 

Reading It 2 1 
Kith 11.-2 1 



.PURPOSE FOR TREATMENT WAS 
KOT CLEAR 

r 

VMETHOOOUXrt FOR TREATMENT 
*AS HOT CLEAR • 

SERVICE KOT BENEFICIAL 



NUMBER OF CONTACTS KAS IN4 
ADEQUATE . (1 

• I 

IWCWMATION SHARED KAS KOT 
VALUABLE , ^ 

W& KOT ABt^E TO ACT ON'IN 
FiWIATION SHARED 



SESSIONS NOT WORT! WHILE 

T«0 NOf^pKlJbCE^XCQUIRED 
SESSIONS" 



»TIME ALLOTTED FOR SESSION^ KAS Reading 112 1 
SUFFICIENT - . *Wath 11 2 1 

INFORMATION SHARED WAS FRACTI- Reading \% 2 
CAL , «ath 12 2 



ft 



WAS ^INSUFFICIENT 



FOR SESSIO 



i 

INFORMATION SHARED WAS ttj 
PRACTICAL 



Cogcnents: Very impressed with tfie proVraiir fn g A\ 
Screening should be reviawftriNfrV^g 7 s ) 



x 
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DIAGNOSTIC READING CLINIC 
1980-81 Title I Evaluation 



PURPOSE AND OVERVIEW 

« * 

The Diagnostic Reading Clinic is designed to provide specialized 
in-depth service to pupils in the upper elementary grades who evidence 
multiple^and complex reading difficulties. Student^ are transported to the 
Diagnostic Reading Clinic to receive reading diagnosis. An instruction plan 
is developed, based on the child's reading difficulties, to be implemented 
in the school reading center by the clinician, classroom teacher and other 
support personnel. Forty-five minutes per day of instruction for approxi- 
mately 32 weeks or until the child is considered remediated is provided for 
each child being serviced. 

SERVICE SUMMARY ' * 

Pupils Served : ,2,068 Grades Served : 4, 5, 6 Years in Operation : 17 

- Title I; 1 



Schools: 



19 public 

1 non-public 

20 total 

(See list in 
Appendix A) 



(15.5 yrs, 
yrs . - 0E0) 



Staffing: 24 Teachers, FT 

3 Psychologists, FT 
2 Coordinators, FT 
1 Nurse, FT 
1 Clerk, FT 
8 Driv'ers, FT .5 FT 
3- Teachers Assistants , 
1 Speech Therapist/, FT 
6 Education Aides, FT 
1 Supervisor, PT 



FT 



Total Title I Expenditures : $1 , 066 , 798 



Per Pupil Cost: - $516 



SUMMARY *0F FINDINGS ' 

'Pupils qualifying for participation in the Diagnostic Reading Ciinic 
received a variety of evaluations to correctly identify all aspecjs of the * 
^^pupils reading difficulties. A plan was developed for each puprflba^d''on 
medical tend reading evaluations. A sample of test results for Children who 
were tes\ed prior to the beginning of participation in the prograft^and again 
after completing, the specialized reading program, indicated that the expected 
♦ gains were made in their reading test scores as a result* of participation in 
the program. Classroom teachers of these pupils reported that over half of 
the students who participated in <the Diagnostic Reading Clinic could independ- 
ently handle the usual classroom heading materials in their grade at least 
half of the time. These teachers and also the parents of participating 
pupils had opportunities to .discuss their pupils's reading progress with the 
reading teacher. 



c 
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OBJECTIVE AND OUTCOMES 



Objective 1 : Pupil participants will evidence & post treatment mean " 
score on a standardized reading test that ia at least seven nCe units 
higher than the mean pre-test score. 

_____ Objective 1 is considered attained . The Comprehension 
subtest of The Gates -McGii#tie Reading Test was administered to each 
child at the beginning of treatment and again .at the end of treatment 
when the child wai considered remediated as /determined by the 
^Clinician. The average number of weeks of service was 32 weeks. A 
'comparison of the pre-post test results for 198 randomly selected 
children in grades 4-6 realize^ a mean gain of 7.05 NCE units. /.The 
following mean NCE gains are reported by grader 



TABLE ,1 



NCE Gains by Grade 
on Comprehension Subtest of Gates-McGinite Reading Tests 

X 







MEAN 


NUMBER 


REPORTING 


GRADE 


N 


NCE GAIN ~" ^ 


'nce 


GAIN OF 7 


FOURTH 


74 


6.19 


35 


(47%) 


FIFTH 


66 , 


__, 6.50 


37 


(56%) , 


. SIXTH 


58 


8.26 


36 


(62%). 



The data in Table 1 show that although performance was only 
slightly below the objective criterion fofc grades four and 
five, achievement of the objective criterion for the project 
as a whole was due primarily to the strong performance at 
grade six. ~ 

The following percentiles are reported by grade for pre-poSt 
comprehension test results. These percentiles reflect norms 
appropriate to tines of year J tests were taken. 



TABLE 2 

Percentiles of Mean Pre and Post test Comprehension 
scores for Students in the Diagnostic Reading Clinic. 



GRADE 


PRE % 


POST % 


FOURTH 

FIFTH 

SIXTH 


13.75 
11.53 

13.58 ^ 

• - 50 - 53 


21.81 
> 19.^ 

25.32 j h 

» > 



1 - * • 

The data in Table 2 show that when participants are compared 
with other students in the* nation they rank in the lower 25 
percent nationally on the Comprehension subtest, both at thef 
pre-tQst and the post-test. 

Although gains we^e made, percentiles indicated that^the target 
population evidences serious reading difficulties that will require 
continuing participation in this project, r 

Objective 2 ; As reported by classroom teachers, at least two out of 
three pupils receiving full service will evidence observable independent 
performance with classroom materials n le'asvhalf of the time, 

i 

Outcome: Objective 2 js not attained , A questionnaire was dis- 
tributed to teachers of* 198 randomly selected pupils in June, 1981, 
Responses to the question related 'specifically to this objective were 
^obtained from the teachers of 154 students. The responses of these 
teachers indicated that 60% of the sample of' students could independ- 
ently handle the usual classroom reading materials used in their grade 
at least 50% of the time. Twenty-seven percent of tHS pupils could 
handle the reading material from 24 to 49% o**the time, and 13% of 
the pupils could use the usual reading material less than 24% of the 
time. See Appendix B for summaries of responses, 

bbjective 3 : tPupils will receive the coordinated services of related 
discipline* in the diagnosis and correction of reading difficulties. 

Outcome : Objective 3 is considered attained . All students upon 
entering "the program are given a series of medical and. reading 
evaluations by the special services staff which form an integral part 
of prescriptive recommendations of the staff prior to implementation 
of treatment. The records fomj the basis of a case study for each 
student. 

Examination 6f case studies of 205 randomly selected students revealed 
that 100 pereent of the students received at least on of these , 
services and 81 percent received all four o*f the services,. The follow- 
ing lists the percentage of students receiving specific services: # 

- Ninety-five percent (N=195) of the pupils in 
the ^sample received psychological testing. 

- Eighty-nine percent (N*183) of tfhe pupils in^ 

the sample received a vision test, * * 

- Eighty-four percent (N*173) of the pupils in 
the sample received a hearing test, 

- Eighty-one percent (N=167) of the pupils received 
a speech evaluation. 

Objective 4 : Parents of at least 50 percent of participating pupils 
will be involved in support of the center's efforts to remediate the 
reading difficulties of their child. 
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Outcome : Objective 4 is considered attained . Results"' of a * 
^questionnaire sent to parents of 198 randomly selected pjupils 
in June 1981, revealed that' 80 percent of the responding parents 
(N=113) reported that they had contact with their child's reading* 
teacher at least once during the project year. An average of 
1.28 parent - teachex* contacts was reported-. See Appendix C for 
summaries of parent responses*.*" The following kinds of contacts 
jwere reported: ^ *' « 

0 * \ A 

, - Sixty- three percent ox the sample of parents 

reported that they had 'received written prog^ss 
reports from their child f s reading teacher. ^* 

- Forty-eight percent of ^the sample of parents 
, reported having telephone or in-person con- ^ 
ference contacts with their child's reading 
teacher. 

• * Five percent of the parents reported that theiT 

child's reading teacher visited their home. ¥ / 



. Additionally, examination of a random sample of 205 case studies 
revealed tfiat an ayerage of three' parental contact forms were 
contained in edch pupil's case stud^. 

Objective 5 : .At least SO percent of -thf classroom teachers of pupils 

served by the ptoj act' will .receive consultative services' from the 

clinic staff. * ' 

« 

. Outcome t Objective 5 is considered attained . Results o£ a 
questionnaire to teachers of* 198 randomly selected pupils revealed 
that 89%** of the responding teachers '(N*151) had an average of three 
opportunities to discuss their pupil's progress with the Reading 
Clinician. ^ & • 

- ^Forty-two percent of the teachers reported 
•having contacts' in the form of written reports . 

*\ « 

- Sixty percent of the teachers reported having 

conferences with their pupil '^-RSading Clinician. 
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ADDITIONAL FINDINGS 

. Eifty-eight percent of the parents responding to a questionnaire 
reported that they believed their child had been helped "A Lot" 
by the program. 

. Ninety-four percent of the parents responding to the same question- 
naire reported that they had seen their child's reading habits change. 

. Parents' reported observing the following changes in their child's 
reading habits: 

- Sixty-one percent reported that their child makes 
an effort to read printed materials on signs or ' 
different types of displays . 

- Fifty-one percent reported that" their child attempts 
to appiy reading skills to newspapers or magazines. 

- Fifty percent of the parents report their .child reads 
more for pleasure. 

. Teacher responses to a questionnaire reported the following degree 
of change in their pupil's reading behavior: 

- On a scale of "1" to "5" ( 1 being "Worse" to 5 being "Better") 

t Forty- three percent of the pupils were rated 

4 ( "Somewhat Better") o* 5 ("Better") in 
confidence in word attack. 

. Fifty percent of the pupils were rated 4 ("SomewhatX 
Better") or 5 ("Better") in their general attitude \ 
toward school. t l 

; Forty-two percent of the pupils wdte rated 4 ("Some- 
what Better") or 5 ("Better") in their independence 
in reading. 

•J ' 
. Project records document that 2*068 pupils were served during the 
1980-81 project year. 

n . 

J - Number of participants who received the following services: 

. \ • Psychological ' i >0 65 pupils 

•• Health - 1,519 pupils 

. . Speech § Hearing > —1,270 pupils 




CONCLUSIONS 



Project records* and case studies document that services were 
delivered to participating students in the form of specialized instruction 
relating to pupil diagnosis. . ~ 

Of the five objectives, four or 80 percent were' fully achieved; 
one was not achieved. a - • 

Project recoils arid average length of service verify the severity 
of the reading problems of the participants. Although the objective 
criterion for NCE gains was met, gains were limited due to the complexity of 
the reading 'difficulties of the target population. * 

* The data in Table 2 show that participants in the sampl^are 
reading in the lower 25th percentile when Compared with students nationally. 
This could account for their lack of ability to independently handle the 
usual classfoom reading materials in thejLr 'grade at le^st 50 percent of 
the time. 



It is recommended that present participants Will benefit from 
continuing participation in the project. 



x 
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APPENDIX A 
Shhodls Seryed 
Diagnostic Reading Clinic 
1980-1981 



rv 



Public 
1 Anthony tfayne 
Buhrer 
Clark 

Daniel E. Morgan 
Forest Hills Parkway 
George Washington Carver 
'Gordon 
Kentucky 
Margaret Ireland 
Mount Pleasant 
Mary B. Martin 
-Mary Bethune 
Orchard < 
Paul Revere 
Stephen E. Howe 
Tremont ' * 

Union 
Walton 

Watterson - Lake 




Non-Public «' 
St. Michael 



•SS- 
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APPENDIX B 



Cleveland Public Schools * 



4 



DIAGNOSTIC READING CLINIC 



Teacher Questionnaire 
N*161 



' \ ; has b.cen receiving the services of the 

.Diagnostic Reading Clinic. We arc interested in securing Yrom you, his/ 
hcr^classrodm teacher, some observations about his/her present reading 
performance. Please fold, staple and rc*\irn tJyrs questionnaire on or ' 
before: Friday, June 19, 1981. 



1 ; ! 

Check the appropriate answer. * ^ ^ 

1. Did you have and opportunity to discuss this child's progress , with the 
Reading Clinician? ^ Yes 134 (89%) , No 17 (11%)' 

. Approximately how many times? 3 (M ean) 

. Check which of the • following contacts you have had with the Clinician? 
You may check more than one. 



Written reports- 42% 
Conferences _ 



Other 



Based on your observations, about o what proportion of the time can this 
child independently handle the usual classroom re&linjr jiujtcrial used in 
his grade?* ' ' 



less than 24% 
13% 



?S tp 49% 



SO to 74% 

' 42% 



75 to 100% 
/ 18% 



Sm Circle 'the number that corresponds- to the degree of change in^this 
- child's behavior. ' > _ 

5 - Better 
•4 - Somewhat Better 
* ;3 • No Better, Hp Worse 

2 - Somewhat Worse 
1 *- Worse ' 



A. Ptipil confidence in word attack. 

t(2%) 2(12%; 3 (43%) 

B. Pupil's general attitude toward school. 

1(6%) 2(9%) 3 (35%) 

C. Pupil independence in reading. 



4(33%) ( 5 (10%)- 
4(31%) \ 3 (19%) 



1 (7%) 



2(18%) 3 {33%) 4 (35%) ^ S (7%) 



4. In your opinion, what is the area of greatest reading improvement for 
this child? 



41% 



^ ^ Compr 



chension' 



35% (^) Vocabulary r 2 3%(3 ^ r(J Anal y si ^ 



5. Child 1 * days of absence for this year as of the date of this report, 
* ' C -S6- ' 



APPENDIX 'C 
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DIAGNOSTIC READING CLINIC 



Parent Questionnaire 
N=113 



- . ! i ' has, been receiving extra help in read- 
ing this year from the Diagnostic Reading Clinic program. Please complete 

'and return this questionnaire to your child's reading teacher on or bef&re: 
Monday, June 15, 1981 . ' ^ 



Check the appropriate answer, 

: v 80% 20% 

1. Have you had contact' with your child's reading teacher ?-tl Yes .C]No 

Approximately* how many times? 1 ( Mean) 
• If yes, check which kinds of contact you have had. 
Conferences (telephone or in person) 
1 Writtqp Progress Reports 
% Home Visits v 
Other 4% " 



| |48% 
□63% 



•108 



85 



9 

ERIC 



Was your child helped by this program? 
' 58% C] A lot • Somewhat' ' 



Not at all 



3. Have you seen your child's reading habits ^change? Yes 
N=113 . If yes, check which changes you have- seen? * 

A, Reads more for pleasure, ' v 

B, Brings home more library books, * 

*t \ 
%> * '* , 

C, Uses more library books for' homework assignments. 



Dso% 

□34% ' 

D., Makes an effort to read printed materials on signs or different I — L,?: 
types of displays. I — I 01 " 



Attempts to- apply reading skills to newspapers or magazines, if 
• they are available. 

F. Other 7% ' 



THANK YOU! 

»• 

Department of Research, Development and Evaluation 
May, ,1981 , 
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EKGLISH-AS-A-SECOND LANGUAGE PROJECT 



Prepared by 

Ella Cleveland 
Project Evaluator 

Typed by 
Gabriel Kaufman 
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Deputy Superintendent 
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E&GLISH-AS-A-SECOND LANGUAGE PROJECT. , 



1980-81 Title I Evaluation 



PURPOSE AND OVERVIEW 



1 ThiS\prpject is designed to/elp second-language learners N atquire 

an adequate level of proficiency in Understanding, speaking and reading the . 
Englishvlanguage. Pupils served by this ^project are provided, in a special . 
clajsjodn apart froifa their regular classrooms, with extra classes in speaking 
and reading English and acculturation activities. These special sessions, 
which average approximately forty-five minutes daily., are followed up with 
-additional individual and small -group reinediatibn ^provided by teacher assis- 
tants, where available, A full-time community coordinator plans and imple- 
ments parent and community involvement in the program, 

SERVICE SUMMARY ^' . 

. Pupils Served : 660 Grades Served : Preschool-8 Years in Operation: 14 



Schools : 15 public 

- 3 non-public 
U total * ' 

(Sefc* Appendix A, 
fable 1, for list) 



Staffing : 1 Project Manager, FT 
' ' ^"Consultant Teacher, FT 

m Teachers, FT. 
8 Assistants, FT * 
1 Clerk, FT ' 
„ ' 1 Community Coordinator, FT 



JotaLPPPP Expenditures : $560,715. 

supwarV of Bindings ~- • • 



Per Pupil Cost : $850 



/ The 19*80-81 English-As-A- Second Langudge^ Pro j ect had positive effects 

on the speaking skills of She students 'serviced, and met with some success in 
increasing the reading 'skills of its participants. Students in Pre-School 
through grade. six Speaking classes "wetfe pre- tes ted i^n November <*and post-tested 
in May. They showed taore than Expected improvement in listening comprehension 
skills at all grade levels. Approximately half of those'served were enrolled 
in reading classes. Students, in reading classes, grades, one-six, were pre-* 
tested in November and post-ttested in May. Four grade levels (out of six) 
made greater than expected gains in Reading Vocabulary, and three grade levels 
(out of six) grew more than expected in Reading Comprehension, 
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OBJE CTIVES AND OUTCOM ES 

— -- ■ • r 

Process Objectives s 

Objective 1: Assignment of an English-As-A-Second Language team, consist- 
ing of an ESL teacher and a teacher .assistant, to schools will be based 
on concentration of non-English speaking students. 

. % . Outcome: Objective 1 was achieved. Eighteen schools and a total of 
660 students participated in the 1980-81 ESL program.- These schools 
were selected because of their .high concentration of. non-English 
speaking children. Four of the 17 ESL teachers had full-time teacher 
assistants; sd/X teachers had teacher assistants 'for half the day, 

. Objective 2: Pupils will be grouped according to needs in oral English 
and reading skills. 

. Outcome: Objective 2~was achieved. All stu^pnts w^re screened prior 
to assignment. This screening involved the use of separate instru- 
ments for reading and speaking. On'all instruments, students* had to 
score at the 33rd percentile or below before acceptance into the pro- 
gram. Screening instrument-s for speaking and reading classes, by. 
grade level, are listed in Appendix A, Table 3. A total of 527 students 
were enrolled in speaking classes and 292 student^ were enrolled in 
reading classes. .Of these totals, 159 students were enrolled in bQth' y 4 
speaking and, reading classes. The schopls and number of students • 
served can be found in Tables 1 and 2 of Appendix A. 

Objective 3: Curriculum program will be carefully structured to include 
language structures and vocabulary that are readily available within the 
daily experiences -of children and geared to^the proficiency levels of 
participants. - - < *" 

. Outcome : Objective 3 was achieved. Curriculum: guidelines, previously 
developed by the project for the speaking and reading classes, were ~? 
reviewed, by four curriculum iommittees. These committees then devel- * 
oped additional guidelines and curriculum materials for Child Devel- * 
opment, Kindergarten , Primary, and Upper Elementary levels. fc Children 
served by the project progress to higher levels of proficiency as mea- 
sured by criterion-referenced tests. 

Objective 4: Parent involvement and participation in the learning experi- 
ence of tl|e children will be actively enlisted by the project staff. 

Outcome: Objective 4 was achieved. The Community Coordinator assigned^ 



7 



.to the project completed 763 home visits, initiated 73 community can- 
tacts, held 22 conferences with principals, participated in 58 parent) * 
education meetings, five ESL Parent Advisory Committee meetings and 
nine city-wide Parent Advisory Committee meetings. In addition, ESL 
teachers are available to parents on an individual, as-needed basis. 
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Product Objectives ' f . 

' " ~ e . ' , « - 

/ Objective 1: Participants in reading classes will sho\$ jdmprovetyenfe in 
the level of reading vocabulary (+7. or more N£E* imits^.an the jnean pre- * 
post^ scores T obtained on the reading vocabulary subtest* of the Comprehen- 
sive Tests bf Basic Skills, (grades one-six). f 

. Outcome: Objective' 1 was achieved at four. out of six grade levels. 
All tests were administered on a pre-post basis, with the pre-tests * 
, being administered* in November, 198P and the v post-te$ts administered, 
in May, 1981, in accordance with the city-wide testing schedule. Pre 
NCE units were derived from fall norms and post NCE units -were derived 
from spring norms. The pre-post results, by grade level, can be found 
, in Table I of Appendix B. . 
* * 

These data indicate that for grade 1, the Average 'NCE, gain was nega- 
tive (-13.19). For grade, 2," althbugh the gain was positive, (+5.11>, 
it was below the stated criterion ,of +7 or more NCE un^ts. For grades, 
3-6, the NCE gain wa^Sbove (+9.22, +1^.46, +10.74/, and#l(). 95 NCE'** • 
units respectively) the statpd criterion. " \ I 

... * . - 4 4* 

Although the objective criterion standard was stated in >teiji*s of NOB 
' units, the following table Will enable the reader to se§ tlje pupil r<* 
standing represented by percentile ra^ks, based on national' notras and 
relative to students of the same age. , « » $ 



PERCENTILE RANK 
Reading Vocabulary 



Grade 


Pre-test 


Post -test 


1 ' 


41 


19 


"2 


14 


19 


3 


2 b 


35 ' , 


* 4 


11 


29 


S 


. 9 


19 


6 


5 


13 



Again, tfre greatest impact appears at grades 3-6* Relatively little 
movement occurred at grade 2 and test performance Actually declined 
_ at grade- 1. It will be noted that post -test percentiles are still 
relatively low on the percentile scale; however, the students at 
grades 3-6 did make good gains. 



*NCE (Normal Curve Equivalent) units are normalized, equal -interval, 
standard scores with a mean of 50 and a "standard deviation of 21.06, 
derived by dividing the distance from the mean to the 99th percentile 
by the same distance measured in terms of normal curve standard .devia- 
tion units (2,3267). The, resulting scale includes 98% of the popula- 
tion which lies between the 1st and tfle 99th percentile. 




Objective 2: Participants in reading classes will show improvement, in 
the level o^reading comprehension (+7 or more NCE units) ort the mean 
pre-post scores obtained on the reading comprehension subtest of^the 
Comprehensive Test^of Basic Skills (grades one-six)/ 

. Outcome : • Objective 2 was achieved >at three out of six grade levels. 
All tests were administered on - a pre-post basis, with the pre-tests 
administered in November, 1980 and the post-tests administered in 
, May, 1981, in accordance with the city-wide testing schedule. Pre 

* NCE units were derived from fall norms and post NCE units were 
derived from spring norms. The pre-post results, by grade leVel, 

• can be found in Table I of Appendix B. * 

These data indicate that for grades one and two, the average NCE gain 
was negative (-15.38 and -13.37 respectively). For grade three, 
although the gain was positive (+6.75) it was below the stated cri- 
terion of +7 or more NCE unifs. For grades four-six, the NCE gain was 
above (+14.77, +19.38 and +7.70 units, resepctively) the stated cri- 
terion. • ' 

Pupil standing in Reading Comprehension's presented in the i following 
> table by the use of percentile ranks.* 



Grade 



PERCENTILE RANK 
Reading Comprehension^ 



Pre-test 



Post-test 



1 ■ 
2 
3 
M 

5" 
6 



52 
25 
19 
9 
8 
6 
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/ Pre-post gain in grades 3-6 is once more documented using percentile 
ranks. . It can also bp seen, using this percentile table, v ,that grades 
1 and 2 post-test scores and percentile ranks declined.* It will be 
noted thaX post -test percentiles are still-relatively low on the per- 
centile scale, but respectable gains were made at grades 3-6. 

Objective 3: Participants in speaking classes at tfte pre- schooled kin- 
dergarten levels will show significant improvement (p^.OS) in listening 
comprehension skills on the mean pre-post scores obtained through and ad- 
ministration of the Test of Auditory Comprehension of Language {TACL) . 

. Outcome: Objective 3 was achieved. The Test for Auditory Coraprehen- 
.sion of Language (TACL) was administered to 100 Child\ Development and 
Kindergarten students in ESL .speaking classes on a pre-post basis in 
November, 1980 and in May, 1981. Using a t-test, there were statis- 
tically significant gains (p^ .001) between pre-and post -test scores 
for both -grade levels for all three of the subtests (Vocabulary, 
Morphology, Syntax). These gains far exceeded the objective' criterion. 
Table 2 in Appendix B presents the results of this testing. , 
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Mean total raw scores were then converted into percentile ranks, using 
an age-range norms table* Students moved from a percentile rank of 
11 on the pre-test to a post-test percentile rank of 54/ 

. Objective 4: Participants' in speaking classes in grades one through six 
will show significant improvement (p^.OS) in listening comprehension 
„ and oral production skills on the mean pr^post scores obtained through 
the administration of the Language Assessment Scale, , % 

• Outcome: Objective 4 was achieved . Students (N=190) i n speaking 

classes in grades one through six were administered both the listening 
comprehension and the oral production subtests of the Language Assess- 
ment Scale (LAS) on a pre-post basis in November/ 1980 and May, 1981. 
. Students in grades one through five were administered Level I of the 
LAS and gradefSlx students were administered Level II of the LAS* 
The results of this testing can be found in Table 3 of Appendix B. 
These results indicate that for both the comprehension and oral produ- 
catiori subtests of the LAS, the pre-post gains were* significant at 
the .001 level at all six grade levels. 

There are no norms tables that will allow for interpretations of these 
raw scores in terms of student standing relative to other students of 
the same age. However, in order to supply the reader with more infor- 
mation regarding the educational significance of the- raw scores, the 
following analysis is offered. The Comprehension Subtest of the LAS 
consists of ten items. Students \mean, gain score pre-post across 
v the six grade levels was 2.10. This is an improvement of approximately 
20% across the ten items. 

The Oral Production Subtest categorizes students 1 language proficiency 
along five levels. Project students gained approximately one full 
proficiency level from pre to post-test. The gain score aver- 
aged 1.12 across the six grades. 



ADDITIONAL FINDINGS • - ' 

As a part of the project activities, students from ESL schools par- 
ticipated in 25 field trips. A list of field trips taken can be found in 
Appendix C. m 

Every attempt was made to coordinate th§ ESL reading evaluation with 
the city-wide testing program and the bilingual program, thereby eliminating 
dual testing of some students. This cooperation proved effective this school 
year. * 



CONCLUSIONS ■ 

The 1980-81 English- As- A-Second Language Project was successfully im- 
plemented according to guidelines contained in the process objectives. The 
project achieved its language skill objectives at all grade levels. The other 
two reading objectives were achieved at some grade levels ♦ At grades 3-6, 
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students made Respectable reading gains. The post-test data for grades 1 and 2 is 
disappointing in that student scores dropped from pre to post-test. i Project 
Management, when interviewed, offered this possible explanation. for the decline 
in post-test spores: Grades 1 and 2 students, being young and inexperienced at 
test-taking, were subjected to different pre-testyig and post-testing conditions. 
The pre-test was administered in a small (N=5) group setting, with careful test 
monitoring. The post^test was administered as a part of the city-wide testing 
program in a large (iN=35) group with less structure and monitoring. Test re- 
sults from previous years do not show this pattern of decline. nor this method 
of post-test administration for these two grade levels. 

The following axe recommendations for the 1981-82 year: • 

Cooperation between ELS, bilingual, and -city-wide testing 
programs should continue. 

Project administration should identify the reasons why reading 
* gains in both vocabulary and -comprehension are below the stated 
criterion at some grade levels and should take any programmatic 
action necessary to eliminate or reduce the difference between 
stated criteria and actual attainment levels. 

It is important to note that ESL has lost teacher 'assistants 
each year; if the assistants are completely eliminated from the 
program due to Budget reductions, the services to children in 
areas §f concentrated individual reinforcement of skills pre- * 
sented "and cbntact with parents will be severely limited. It'1& 
therefore recommended that the teacher assistants be retained 
on t«he ESL team. 
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APPENDIX A - 
TABLE I 

"Schools and Students Served 
1980-81 

* 

Schools Served 



Public 

— — — — _ . ^ 

Buhrer 
Case 

East Madison 

Joseph- Landis 

Kentucky 

Marion Seltzer 

McKinley 

Mil ford 

Orchard^ 

Paul Dunbar 

Riverside 

Scranton 

Tremont 

Walton 

Waverly 



Non-PubJLic 

St. Francis 
St. Michael* 
St., Vitus 



TABLE 2 



Count of Pupils by Grade Level 



Grade 


No. 
Public 


of Students 
Non- Public 


Total 


Child Development 


36 




. 36 


-Kindergarten 


119., 


- 29 


148 


Grade 1 


90 


11 


101 


Grade 2 


75 


6 


81 


Grade 3 * * 


79 


•9 


88 


Grade 4 


73 


5 


' 78 


Grade 5 


56* 


, 8 • ' 


64 


Grade 6 ( 


52 


7 


59 


Grade 7 




1 4 • 


4 


Grade 8 


jt_ 


1 ' 


* 1 


Total * 


580 


s 80 


660 
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APPENDIX A (Cont'd) 



TABLE S 
SCREENING TESTS 
READING CLASSES 



Screening Test 



Grade 



•Screening Test 



Grade 



in 



For students previously 
Cleveland SystemO "^ 
Metropolitan Readiness Test, 
Kindergarten administration 1 
(Spring, 1980) 

For students new to Cleveland 
System: 

ESL teacher administered , 
Metropolitan Readiness Test, 
Fall, 1980 

For students previously in - 
Cleveland System: 
CTBS, Level B, Form S first 
grade (Spring, 1980) adminis- 
tration,, appropriate score 
one one of the following sub- 
tests: Word Recognition I; • 
Comprehension; Word Recogni- 
tion II 



For students new to Cleveland 
System: 

ESL teacher administered 
California Achievement Test, 
level II, Form A Reading 

\ Comprehension w Reading 

* ^cabulary subtests 

ERIC 
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For students previously in 
Cleveland System: 
CTBS, Level C, Form S, 2nd 
grade administration (Spring, 
1980) Reading Vocabulary or, 
Reading Comprehension: 
Passages subtest . 

For students new to Cleveland 
System: 

•ESL teacher administered 
California Achievement Test, 
Level II, Form A Reading 
Comprehension or Reading 
Vocabulary subtests (Fall, 
1980) 

Stanford Diagnostic Reading 
Test 2, Reading Comprehension 
subtest*,- <j£een Level, pall 
1980. Administration through 
city-wiJe testing • 
or 

ESL' teacher administered 
California Achievement Test, 
Level II, Form A Reading 
Vocabulary or Reading Com- 
prehension subtests (Fall, 
1980) 



,3 



APPENDIX A (Cont*d) 

TABLE 3 
SCREENING TESTS 
READING CLASSES 



Screening Test 



Grade 



Stanford Diagnostic,£eading 
Test 2, Reading Comprehension 
subtest, Brown Level, Fall, 
19S0. Administration through 
city-wide testing 
, or 

CTBS/ Level II,. Form S, 4th 
grade administration (Spring, - 
1980) Reading Vocabulary or 
Reading Comprehension sub- 
test , 

Stanford Diagnostic Reading 
Test 2, Reading Comprehension 
subtest, Brown level, Fall, 
1980. Administration through 
city-wide testing program^ 
or 

ESL teacher ac&dnistered 
California Achievement Test, 
Level 3, Form A, Reading 
' Vocabulary or Reading Compre- 
hension, Fall 1980 *~ . 



(/ 
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TABLE 3 
' SCREENING TESTS 

» 

SPEAKING CLASSES 



Screening Test Grade 



Screening Test for Auditory CD 
"Comprehension of Language* 
(STACL) Fall, 1980 Adminis- K 
tration • ' 

- SPLIT TEST (Schutt: '1 
University of Arizona) 2 
Verbal Fluency-English 
Subtest i Fall, 1930 Adminis- >x 
tratibn 

Fall, 1980 Administration of { 3-6 
Language ■ Assessment Battery 
English Level l\, Grades 3r6 
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APPENDIX B 



TABLE 1 



Vocabulary and Comprehension Subtests 
Mean NCE Gains by Gr.ade 









Vocabulary 




Comprehension 










NCE 






- NCE m 




Grade 


N 


Pre-tesf X ' 


Post-Test X 


X Gain 


Pre-test X 


Post Test X • 


X Gain 


1 . 


• 13 


45.83 


32.46 


-13.39 


5lT92 


36,54 ' 


-15.38 


2 


~~19 


27.21 


32.32 


+ 5.11 


35.53 


22.16 


•4T3.37 


h Z 


31 


3S.94 


42.16 


+ 9.22 


32.19 


38.94 


+ 6.75 


4 ■ 


'26 


24.35 


38.81 


+14.46 


^77 


35.54 


+14.77 


S * 


26 


20.88 


3jL62 


+10.74 


20.81° 


•40.19 


+19..38' 


6 


20 


- 14.65 , 


25. 6p 


+10.95 


,16 .25 


23.95 


+ 7.70 


j Total 


135 
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APPENDIX N B ^Cont'd) 
# - ■ 

TABLE 2 - 
Nummary of Pre-Post Testing 
TACL, Child Development axid <4&nder»rten 





Vocabulary 


Morphology 


Syntax 


* N 


100 


100 


100 


Pre-Test X 


27.70 


24.52 


5.46 


Post-Test X 


35.53 


37.78 


8.13 


S. D. Pre 


7.36 


8.55 


2.40 


S. D. Post 


3.13 j. 


5.85 


1.78 


t 


13.024* \ 


18.179* 


10.340* 


X pre-post gain 


7.83 


v> — ' 13.26 


2.67 


S. D. pre-post gain 


. , 6.01 


7.29"" 


2.58 



, p<.001 



?4 
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TABLE 3 
Summary of Pre-Post Testing 
V Language Assessment Scale, Grades 1-6 



Grade 



Subtest 



Comp. 



N _ [53 
Pre Test X D 4.15 
Post Test X I 6.58 
S. D. Pre D 2.15 

S. D. Post R 1.56 

t | 8.371* 

X Pre-Post Gain 

Gain- fl 2.43 
S. D. Pre-Post 

Gain | 2.12 



Oral 
Prod. 



53 
1.02 
2.09 
0.77 
0.97 
8.009f| 

1.08 

0.98 



Comp. 



35 

4.46 

6.63 

2*63 
•1.68 

6.096* 

2.i7 
2.11 



Oral 
Prod. 



35 
1.34 
2.77 
1.06 
1.11 
9.220* 

1.43 

0.92 



Comp. 



31 
5.97 
7/58 
1.92 
2.81 
3.233* 

1.61 

2.78 



Oral 
Prod. 



31 
2.06 
3.16 
1.03 
1.13 
9.382* 

1.10 

0.65 



Comp. 



21 

4.86 
7.14 
2.29 
1.39 
4.824* 

2.29 

2.17 



Oral 
Prod. 



21 
1.71 
2.62 
1.10 
0.92 
5.396* 

0.90 

0.77 



Comp. 



31 
5.39 
7.58 
2.70 
1.69 
6.472* 

2.19 

1.89 



Oral 
Prod. 



31 
1.81 
2.94 
1.14 
0.77 
7.105* 

1.13 

0.88 



Comp. 



Oral 
Prod. 



.63 
.11 
,19 
• 37 
.271* 

.47 

.22 



19 
1.68 
2.63 
1.00 
0.83 
4.869* 

0.95 

0.85 



*p <.001 
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APPENDIX C 

ESL Field Trips 
1980-81 



Zoo 

Aquarium 



Western Reserve Historical 

Society, Crawford Auto-Aviation Museum 

Natural History Museum 

Hale Farm 

Greenhouse 
Neighborhood Tour 

Trailside Interpretive Center 
. Garden Center 

* North^ Chagrin Metropolitan Park 
Channel 8 
Pick-N-Pay 

Rainbow Babies 1 and Children's Hospital 
. Cleveland Public Library 



4 
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MATHEMATICS SKILLS IMPROVEMENT PROGRAM 



Prepared by 

Richard Leiken 
Francis D. Sullivan 
and 

Derek Taylor 
Project Evaluators 



Typed by 
Caryl Hissam 



Margaret Fleming 
Deputy Superintendent 



1980-1981 
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MATHEMATICS SKILLS IMPROVEMENT PROGRAM 
, % ' * 1980-81 Title I Evaluation 

PURPOSE AND OVERVIEW - ; 

♦ - t 
The Mathematics Skills Improvement Program (MSIP) is designed to 
serve students in grades 3-6 (2-8 in non-public schools) who have demonstrated 
difficulties in the acquisition of basic mathematics skills. Mathematics con- f 
sultant teachers provide these students with daily remedial instruction in 
specially equipped. mathematics laboratories outside of the regular classroom. \ 
Instruction is provided on an inflividualized and small-group basis and is in 
addition to the mathematics instruction provided by the regular classroom 
teacher. Additional services provided by the project include workshops and 
ins ervic^ training for the Title I mathematics consultant teachers, involve- 
ment of parents in the instructional program of the project, demonstrations 
of mathematics teaching techniques for regular classroom teachers and publica- 
tion of a newsletter to disseminate" pertinent information about the project 
to parents and staff. 

SERVICE SUMMARY 

Pupils Served ; 3,081 Grades Served : 3-6 public Years in Operation : 13% 

2-8 non-pub. 

Schools : 49 public Staffing : 1 Project Manager, FT 

10 non-public 58 Consultant Teachers 

59 total (57 FT, 1 PT) 

(See*li$t in Appendix A) 

- Total Title I Expenditures : $1,882,183 Per Pupil Cost : $611 

ySlMARY OF FINDINGS , , 4 

) . % 

. . The evaluation data indicated that the program services of the Mathe- 
matics Skills Improvement Program were delivered essentially as proposed. Some 
difficulties were noted in maintaining specified project enrollment levels in 
the non-public schools, and in. schools served by part-time mathematics consul - 
tantf . Aj*o, it was foui\d that the number of school days on which project 
services were available fell somewhat §hort of that proposed, and recommendfi- 
tions were made aimed at increasing the -amount of instructional time offered. 
Extensive parenj involvement activities wjgfr conducted by the ^project staff 
and the attitudes toward the project of t : j^foarents of participating students 
Were highly positive. A regular series °^Bk aff development activities was 
alsq held for th€ project teachers « •> 
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The results of mathematics achievement testing at grades 4, 5 and .6 
showed\hat participants in the program showed significant growth in their 
mathematiHs "skill levels. The rate of growth exceeded the standard establislfed 
by the project obifectives. Despite the substantial improvement in achievement 
levels, howewr, students continued to score relatively low as compared with 
national norms\ 
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OBJECTIVES AND OUTCOMES - v 

. Pro cess Objective 1; Each full-time MSIP consultant will provide an 
average daily enrollment of 48 mathematics underachieves from grades 
three through eight with remedial instruction in mathematics skills. 
An enrollment variance of iio more than seven percent^(7%) will be accept- 
able. . *• - 

Outcome: An examination of- enrpllment summaries maintained by each 
consultant teacher revealed that this objective was achieved in the 
public schools but not in the non-pub liCschools. All public schools 
served <by full-time mathematics consultants had average proj»ect enroll- 
ments within the range of 44.6 to 51.4 students. (48 students + 7%). 
The actual enrollment averaged 48.01 and ranged from 45.625 to 50 stu- 
dents. In the non-public schools only tw<$ of the five schools with 
full-time consultants attained the objective. Enrollments ranged from 
39.5 to 47.9 and averaged 42.45. J 

Records maintained bjr the project office showed that in 1980-81, the 
project served a total of 3,081 -students 4tf grades t*fc> through eight. / 
TThe majority of students served (2,747 or 89%) were in grades 4-6. 
Students who were served in grades 2, 7 and 8 were. in non-public schools 
only. (Appendix B presents the numbers of public and non-public stu- ~- 
dents served by grade level.) Students identified for service we** 
scheduled for daily instruction in a mathematics laboratory with a 
mathematics, consultant' teacher. Instruction was individualized and 
in small groups and was in addition to the mathematics instruction 
received in the regular classroom. 

• Process Objective 2 ; Each part-time MSIP consultant will provide an 
average daily enrollment of 20 mathematics underachieves from grades 
three through eight with remedial instruction in mathematics skills. 
An enrollment variance of no more than seven percent (7%) will be accept- 
able, h 

Outcome:" The data obtained from enrollment summaries maintained by 
each consultant teacher indicate that this objective was not achieved. 
Although the overall average enrollment was 19.85 students,, only one 
of the two public and five non-public schools with part-time MSIP con- 
sultants fell within the 18.6 to 21.4 student enrollment range speci- 
fied by the objective (20 students + 7%). Average enrollments for 
individual schools ranged from 15.6 io 24 students. . . - 

. Process Objective 3: MSIP consultants will provide for each remedial 
Mathematics student one 40-minute period of small group instruction- for 
at least 90% of the days that the school is in session each semester. 

. Outcomes: Data available from project records indicate that this ob- 
jective w as not achieved. Only two of the 59 project schools offered 
MSIP instruction for at least 90% of the days school was in session. - 
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The percentage of instructional days ranged from 63.9% to 92.8% and 
averaged 83.9%. Eighty-five percent of the schools offered MSIP in- ; 1 
struct ion for at least 80% of the days school was in session. 

Asked why most projecfc*-£3hools had recorded periods of no project 
instruction totaling between four and five weeks of the school year,- 
the project manager reported that a number of factors were involved. 
First, all project consultant teachers participate in monthly in- 
service meetings, on which days their mathematics instruction is not 
■ -offered. Over the course of the year, inservice meetings consume 
• almost two weeks- of instructional time. Second, in calculating the 
number of instructional days * the days on which a mathematics consul- 
tant teacher was absent due to illness were counted as days qn which ' 
instruction was not offered. Third, it was reported that between 
two and three weeks are required in the fall to identify and schedule 
the students who are to receive instruction. Although test data are 
already available for many students from tests administered the pre- 
vious spring, the identification process is complicated by high pupil 
mobility rates and delays in the transfers of records which require 
the consultant teachers to administer additional tests in the fall 
to determine eligibility. The practice in most schools has been to 
wait until most of the eligible students have been identified and 
scheduled before beginning the instructional'program. 

Process Objective 4 : When surveyed, 75% of the parents of MSIP students 
Will be able to acknowledge being contacted by the Mathematics SkiUs 
Improvement Project. * 

. Outcome : The data available indicate that the objective was achieved. 
InMay7 1081 each mathematics consultant teacher was provided with a 
supply of questionnaires to distribute to the parents of a sample of 
the students receiving project services. A total of 94 parent ques- 
tionnaires were returned. Analysis of the responses to the question- 
naire showed that 93% of the parents responded in the affirmative 
when asked if they had received any written information about the 
special mathematics instruction being provided for their children. 

Further analysis of the questionnaire responses showed that 67% of 
the respondents had made at least one vigit to their child's-tMSIP* 
class during the 1980-81 school year/ Jn addition, 88% of the parents 
reported that they believed that their ; child had improved -ill his mathe- 
matics skill more than before.- (A summary of the parent questionnaire 
" Responses is presented in Appendix C.) 

Projects records 6how that, with the exception of May, 1981, a meeting 
for parents of participating children was held' every month from October, 
v 1980 thrcfcigh June, 1981, a to,tal of eight parent meetings. Th,ese meet- 
ings deaj||with a variety of topics ranging from explanations of pro- 
ject bperltions and procedures to the distribution of instructional 
materials and -the explanation of methods for parents to use tb help _ 
teich their children at home. The culminating activity for the year 
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was a^Math Myii-Fair held in June in which all of the mathematics ' 
consultant teachers worked with parents on the use of hopie -in strut - 
materials designed and constructed by the consultants. * De- 
the* individual parent meetings may be found in |Appfcndix D. 

* ** * \ ^ ' | ^ 

Product Ofc>j eritive 1 : The MSIP observed griup mean post-test performance 
willie atleSit fiv$;NCE units /above the expected group mean score which 
has been estimated' by regre§sion t analysis of Spring, 1980 and Spring, 
1981 CTBS Mathematics Test^cQresl Arfalysis will be by grade >lei>€ls 
three, four^ five and six. f , * . « \ 

' . « t ' . * 

* Outcome : The data show that /this objective was achieved at grade 4/, 
5 and 6, D^ta> were not available ^or, grade ^, The mean post-test \ 

* perfopnan^p Apr all gradel^els combined was 8,54 NCE units above} 
the expected ipesta post-test score, exceeding the five NCE units s^e^L- 

'fied by the^ objective. ^ * - * , 

To assess progress toward the attainment of the objective, tljp test 
performance of the 'students served by thV'project was compared with 
an estimate of what 'their test performance would have been if they 
had rio.t participated. This "expelled" -level of perfQxmance was ob- 
tained by conducting a regression analysis on the'Spjing, 1980, and m 
Spring, 1981 test scores^of students whp did riot quality for Title Ji 
service and who did not participate ifetySIPv" The; analysis madte it ' 
possible to predict the 1&81 test .performance of MSIP stu^ent^^rom 
their performance levels' the previous j^ear/. Their actual.,1981 scores 
were then compared*with their expected 1981 scores to determine tif. * 
participation in i#k project ha£ raised their performaftce Aayels 
above the level that would have been expected if they had trot ^ par- 
ticipated, - 'X ' 

< Data were collected for grades 4, 5 and 6 using the Comprehensive 
Tests \f Basic Skills (CTBS) Mathematics Jests administe^KcitV- . 

* .wide in the Spring of 1980 and 1981. (Regression analysis could 

not be conducted for grade 3 because mathefoatiqs tests are not admin- 
istered city-wide at grade 2, and so the 1980 data needed to derive 
the' expected scores for grade 3 in 1981 were not. available,) The 
analysis was conducted using the'TotaJ. Mathematics score from the 
>; CTBS T Appendix E shows the 'specific level, forilf and 'dates of admin- 
' istration of the tests administered at each grade > Tafrl^I shows 
the results of fhe comparison between actual and expected post-test^ 
Total Mathematics NCE scores .achieve^ by the MSIP students at <ea<*h 
grade level, * \ ' 
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Table 1 



Actual ancVExpected CTBS Tc^tal Mathematics Post-te^t NCE Scores of 
Students Participating in Mathematics Skills Improvement Program 



Grade 


N 


Expected Average 
NCE Score " 


Actual Average 
.NQE Score. . 


Actual- Expected - 
■ Difference 


. % of Students 
Gaining' 5 NCEs 


" 4 


' 433 


- 30.05 


36. 60 


+ 6.55* 


• 55% 


5 


547 


.28.39 • 


*'* 39.41 ' 


+ 11.02* '. 


67% 


6 


236 


29.96 


36.42 . 


+- 6.46*' 


65% 


Total 


1216 ' 


29.29 . 


37.83 


" +8.54 


1 — 

63% 



'Statistically significant (p<.001) ^ 

Table 1 shows that the objective criterion of a mean difference of at 
least 5 NCE units between actual and expected post -test scores was 
exceeded at eadh grade levfel and for the project as a ; whole. Tn 2ddi- 
tion, the 'differences between actual and expected average scores were 
statistically significant at all three grade levels as determined by 
t-test for correlated measures. The table also shofcs that at each grade a 
level, over half the students achieved the objective criterion <on an 
individual basis. (Data on the 1980 and 1981 test scOrfcs of both MSIP # 
and non-MSIP groups along with the regression analysis and t-test 
statistics 'may be found in Appendix F.)' * • 

The objective criterion Was stated in^terms Qf NCE units. To help the 
reader, see how the projecf-sfudents rank relative to qtlfer students the 
same age, Table 2 presents the percentile ranks of their average NCE 
scores ,based on national norms. Percentile ranks are presented for the 
students 1 scores in 198Q and 1981. 



Table 2 



V* 



Percentile Ranks of Average 1980 and 1981 Total Mathematics 
Scores* Obtained on the CTBS by Students Participating 
*in the Mathematics SkiJLls Improvement Program 



er|c 



• 


l 

• Grade 


I980 ( . 
Percentile 


"v.* M81 ' 
Percentile . . 




4 : 


17 . 


• 26 

■ 






V 

5 

* » ■ 


14 " ' 


• . V- .31 


. & 


c 


A 6 


' ; • ' i4 - S *" 


.26 






m » 
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The table shows that despite the substantial gains^in performance, 
students served by the project still rank in the lower third of 
students nationally after participation in the project and are likely 
to reqt^ire continued service. 



ADDITIONAL FINDINGS * - • 

V 

s * Project records showed that regular inservice meetings were conducted 
for the project's mathematics consultant teachers. Consultants attended a total 
of seven such meetings between September, 1980 and May, 1981. In x addition, 
separate inservice meetings were held "for MSIP consultant teachers who joined 
the project for the first time in 1980-81. Topics for the^meetings included 
M&IP record-keeping procedure, testing procedures, the use of -new mathematics 
textbooks, stijdeht selfectigp. procedure, dia«gnosis and correctxuiT of ski^l * 
weaknesses, the use of instructional games 'materials development and the 
like. Appendix G presents details on each -inservice meeting held. ' 



CONCLUSIONS 



The evaluation data showed that,yith some exceptions, the?, pro j ect 
services offered by ^he Mathematics Skills Improvement Program were deliver§d 
♦as proposed. 'Two of the four process objectives were achieved. The data also 
showed that the project had a positive" impact on student mathematics achieve-; 
merit fs the participating' students demonstrated test score gains beyond the.. \ 
levels specified by the project's one product \obj ect ive. 

Supplementary mathematics instruction was provided in individualized 
"and small group settings for over 3,000 elementary* school students who had 
'demonstrated weaknesses in mathematics skills* Program enrol lment> levels were" 
maintained at proposed levels in the public schools served by full-time math- 
ematics consultants, but some difficulty was noted in maintaining projected 
levels in the non-public' schools and in schools served by part-time mathematics 
consultants. Additionally, the project objective' dealing with the number of 
school days <m which instruction would be made available was not met as the - 
number of instructional days fell somewhat below projected minimum levels. 
The project manager cited deJays associated r with pupil identification and 
scheduling and time lost due to staff inservice sessions and -staff absence , 
^ as factors contributing' to reduced instructional time.- Other project activ- - 
ities included extensive activities for parents of participating students, 

* and inservice sessions for the, project staff. Parent reaction to the project 
, L was highly positive. ' ^ 

' „ Student mathematics test scores 'averaged 8.5 NCE units' higher than 
would have beeij. expected had they not participated, but students still scored 
in the lower one third of students nationally. 

* « - 

The Mathematics^ Skills Improvement Program has been demonstrated to 
-be a worthwhile project which effectively contributes to the improved math- 
ematics achievement of the students it serves. Several recommendations are 

* V offered for future operat j<6ns : • ■ 
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Means, should be explored for decreasing the amount of non-instruc- 
tional time noted in project operations. Possible means might in- 
clude reducing the amount of time devQted to project staff inservice 
meetings or attempting to schedule them after hours or on weekends. 
The latter would, -of course, have implications for the project bud- 
get. Another possibility would involve beginning instruction in the 
fall with those students for whom eligibility information is readily 
available without waiting for the MSIP rosters to be completely filled 
before beginning. Students without eligibility information could 
then be 1 'added as the, information became available. v The testing of 
students lacking eligibility infoiroation would be speeded if MSIP 
purchased and had on hand its own testing materials. This is par- 
ticularly true in non-public schools where testing materials are not 
always readily available. 

It is the recommendation of the'project manager that Process Objective 
.3 be reworded to focus on the opening date of MSIP instructional activ 
ities rather than total number of instructional days offered by the 
.pro j feet. ' < < 



\ 



APPENDIX 



Schools Served by Mathematics, Skills 
.Improvement Program 

1980-81 
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Public Schools 

Andrew J. Rickoff 
Anthony Wayne 
Art emus Ward 
Benjamin Franklin' 
*Brooklawn 
Buhrer • 

i 

Case 

.Charles H, Lake 
Chesterfield 
Clark 
Cranwood 

Daniel E. Morgan 
East Madison 



Emile B. ^DeSauze 



, Euclid Park ' 

Forest Hills Parkway 
Fullerton 
Garfield * 
"George W« Carver 
Gordon 
Gracemosnt 
</ Jfelle 



V 



*1 semester of service^ only' 
* .* ■* i j 



*He$ry W.. Longfell 
Kenneth W. Clement 
Kentucky 

Margaret Ireland 
Marion-Sterling 
Mary B, Martin 
Mary M, Jethujie 
McKinley 
Memphis 

Mi'fes Park 1 ' 
Milford 
Mount Pheasant 
Nathaniel Hawthorne 
Oliver Hazard P*erry., 
Orchard 
Paul Revere 
Robert Fulton 
Stephen E« Howe . 
Tremont 
IWion n . 
^Verda Brobst 
Wade Park - 
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APPENDIX A (continued) 

-Schools Served by Matfiematics Skills ■ 
„ Improvement yogram 

1980-81 

Public Schools (continued) Non-Public Schools ^ — 

• ^ ~~~~ ^ ~~ 

Walton . • ' . St. Aloysius 

lot* y * • 

Warner ' ' ^ St.' Joseph Collinwood 

Watterson-Lake St. Catherine . 

. wil low . " Mt< Pleasant Catholic 

William Harper St. Paul Croation 

* *-St. Benedict . 

Holy Rosary 

Immaculate Heart of Mary 
St, Rose 

f v 

* . Annunciation 
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APPENDIX, B" 

• » • • 



Number of Students Served by tjie Mathematics Skills 
Improvement Program by Grade Lgvpl 



Grade 



Number pf Students 



Public 



Non-Public 



Total 



Percent of 
, Total 



. ' 2 






10*. 




10 . ' 


.3 


3 


188 




•76- 




264 , 


8.6 


4 


1020 




65 




• "1085 


35. '2 


$• 


822 . 




52 




• 874 


• %l 28.4 


6 


731 




57 




788 ° • 


0 

2-5.6 


7 






32 




32 


1.0 


m 

.8 • 






2*8 




28 

• r 


if 

.9 


Total 


276\ 




320 




3081. 


100% 



\ 
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APPENDIX C 



PARENT SURVEY REgPflH^E SUMMARY 



f * CLEVELAND PUBLIC SCHOOLS 



Mathematics Skills Imp]^vemefrt---fTOj6'ct 



Dear Parent: 



Wq^re pleased that your child was part of a group who were given 
special instruction in Mathematics. We now wis s h^to know how you feel about 
this special help. Please help us by circling your answers to the questions t 
below. t 



ITEM ( ( FREQUENCY OF RESPONSE 

1. Did you know that your child^wks -YES - 98% NO - 2% 
. receiving special ins true tio^iN^ 

mathematics? - 

y ' \ 

2. Did you receive any written in- YES - 93% NO - 7% 
formation a^out this special ^ 

mathematics instruction? 

; v 

3. , Did your child bring home to show YES - 89% ; N0 - 11% 
' 'you any arithmetic paper or /Other 

object from his arithmetic /teacher?; . 

4. Have you visited your child's special YES - 67% NO - 33% 
mathematics class? 

* \ 

^ S,. * Did your child talk to you more MORE - 64% SAME - 35% LESS - 1%^ 

about his arithmetic class this 
s.efmeister than before? ^ 



6. Dc^you feel yofc child impr$fved MORE - 88% SAME - 11% LESS - 1% 

in arithmetic 'more this semester 
than beforfe? , 



% ; ; ; — 

Please have your child return this questionnaire to his special, math 
teacher, on the next s.ch0&l day. 



Thank you, very much., 



< T 
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APPENDIX D 



Parent Meetings Held by Mathematics Skills 

* * Improvement Program in 1980-81 4j> t 



Date 



October 29, 1S80 



November 19, 1980 



December 17, 1980 



. January 28, 1981 



February 25; 1981 



Match 17, 1981 

r~ - ' . 

March 25, 1981 



April 29, 1981 



June 3^Z981 ^ 



PiV^o: 



Meeting, Topic (s) 
ose and Structure of MSIP 



Presentation by project manager of Project Prid.e 
, on , "Being Aware of " Myself 11 

Introduction of components of MSIP 

Ways of imprpving parent participation 

Distribution of descriptive materials on the 
^MSIP- and- home-activity materials 

Demonstration of mathematics games 

Mathematics games 

Techniques for teaching addition facts s ' 

Election of o'fficers 

• Distribution of descriptive materials on the 
MSIP and home activity materials 

' *Home u$e of materials for teaching division 

Techniques for teaching multiplication at 

♦ home * 

Observation of MSIP classrooms* 
■ Report on observations of MSIP classrooms 1 
Discussion of MSIP Mini-Fair 
Mathematics 9 games : . 

Review of MSIP proposal for purpose ofl making 
recommendations for 1981-82 , » 

MSIP Mini-Fair distribution and demonstration 
of home-activity mathematics materials designed 
by^mathematlcs consultant teachers 



( 



% ■ 
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APPENDIX E 



-FORMS , LEVELS AND DATES OF ADMINISTRATION OF COMPREHENSIVE TESTS 
OF BASIC SKILLS USED. IN EVALUATION OF MATHEMATICS SKILLS. 
. IMPROVEMENT PROGRAM 

1980-81 . ' 



—» ' 

Grade 


Level i 


1980 
Form 


Test 

Date 


Grade 


*»Level 


1981 
Form 


Test 

Date 


3 


p 

2 . 


S 


- April, 1980 


-» 

4 

> 


2 


i s 


#y., 1981 


4 


2 


T 


April, 1980'. 




f 2 


r 


April, 1981 




2 


S 


March, 1980 


6 


2 - 




March, 1981 


* 




V 
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APPENDIX ^ 



Mean 1980 and 1981 CTBS ^al Mathematics NCE Scores for MSIP 
and Non-MSIP Students with Regression Analysis and t-Test Statistics 











NON-MSIP 


STUDENTS 















MSIP STUDENTS 




4 












fa • 


Regressi 


on Statistics 










Expected Jj£81 
x NCE S.D. 


1981 Difference 
(Expected vs Actual) 






Grade 


N 


1980 
x NCE .S.D. 


1981 
x NCE S.D. 


1980- 1981 

1 X, 


Slope 


y 

Intercept 


N 


1980 
x NCE S.D. 


1981 


.S.D. 




d£ 


4' 


3440 


59.13 8.62 


53.84 


15.26 


.457 

<» 


.809 


6, 01 


433' 


29.72 10.28 


36.60 


14.93 


30-05 7.. 32_ 


" 


8.97* 


432 


5 


3272 


58.78' 9.21 


55.68 


i 

14.55 


.551 


.872 


4.43 


547 


27.48 10.09 


39.41 


i . 

14.35 


28.39 8.'79, 


+11.02 i 


17.. 28* 


546$ 


6 


3132 


56.71 8.79 


*3.58 


12. 6*2 

u 


.559 


.802 


8.12 


236 


27.25 10.29f- 


36.42 


11.14 


29.96 7.43 


+ 6.46 f~ 


t 

"""9.46* 


235. 



I 

to 
to 
I 



NOTE : Students were included in the analysis'as part of the MSIP group if they achieved an NCE score of 42 (33rd percentile) or below on the 1980 test 
a and received project services. Students were included in the analysis as the non-MSIP group if they achieved an NCE '^score above 42 on the 1980 
* "test and did not receive project services. All other student* were eliminated from the analysis. In addition, following the recommendations, of . 
Tftle"T~technical consultants from Educational Testing Service, the students whoscored in the top 20* on the 1980 test were arbitrarily eliminated' 
* from the arfalysis to minimize the chances of ceiling effects contributing to non-vlinearity of the regression line. 



ERJC 



92 



93 



APPENDIX G 



Inservice Activities Conducted for Staff of 
^Mathematics Skills Improvement Program in 1980-81 



Date - * 

September 17, 18, 
(All day) 



Audience 

19 Public school mathematics 

'consultants 



September 23 
(All day) ' 

Ot'tober 2 
(All day) 



October 27 
(All day) 



December 9, 10' 
(AU day) 

■ ( 



January 3b 
(Half day) 

February 26, 27 
'(All**day) 



March 30 
(All day) 



April 30 
(Half day) 



May 22 * 
(Half day) 

ERIC 



Non-public school math- 
ematics consultants 

Public and non-public school 
"mathematics consultants 

Project STAR teachers* 



First year mathematics 
consultants 



All mathematics consultants 



,*A11 mathematics consultants 



Newly hired mathematics 
consultants * 



All mathematics consultant^ 

*** » 

- All mathematics consultants 

■ ■ x 

All mathematics consultants 

-93- 



Topic (s) 

Procedures for record-keeping, 
student testing and student 
selection 

Major ingredients of MS IP 

Distribution of instructional 
materials 

Same as above 



Title I regulations as applied 
to MSIP 

Structure and use of new math- 
-ematics "textbuok ~~ 



Student eligibility procedures 

Construction of instructional 
materials 



Techniques for teaching place 
value 

■ c 
Diagnosis and correction of 
mathematics skills' deficiencies 
(Dr. James Heddens, Kent State 
University) 

Attribute blocks and their use* 
in a mathematics lab 

Procedure/ for record-keeping, 
student "testing and student, 
selection y 

Major ingredients of MSIP 

Distribution of instructional 
materials 

v 

Problem-solving strategies • 
through th$ use of mathematics 
games 

Planning and production of 
materials for* MSIP Mini-Fair 
for parents 

Completing preparations for * 
MSIP Mini-Fair 



9 'J 



. PROJECT STAR 



Prepared by 



Ronald Gerboc 
Project Evaluator 



Typed by 
Constance Brewton 
Lauren Dillard 
Pamela Yontosh 



Margaret Fleming 
Deputy Superintendent 



• 198 0-1981 
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V PROJECT STAR' S\ > * 



v . ' 1980-81 Title I Evaluation 

/ . # « 

r • • * 

PURPOSE AND OVERVIEW - ~ 

# • • * 

Project STAR (Skills Training for Achievement in Reading) offers / 
Grade v 4-12 students who are poor readers three types of assistance: (1) \ 
Block Classes -^Grade 7 public school students attend English and social 
studies classes scheduled for consecutive 45 minute periods in the same room> 
A Block teacher and aide 'assist the regular English and social studies teachers 
in teaching these classes. Project staff also provide Block students with 45 
minutes of daily study skill tutoring; (2) Learning Centers - A project teachop 
and aide provide public school students in Grades 7-9' with one 45 minute period 
of daily programmed reading instruction; (3) Nonpublic School Classes Grade 
4-8 students receive one 45 mihute period of reading instruction daily. OnST 
senior high school provides Grade 10-12 students with reading and study skill 
instruction.* y , • * 

f 

SERVICE SUMMARY V 



Pupil j/i 



Served ; 4,123 Grades Served : 4-12 Years in Operation : *15 



Schools : 24 public * , Staffing : • „ o r 

19 nonpublic 1 Project Manager, FT 4 Consultant Teachers, FT 

43 total 2 Social Workers, FT 32 Learn/ Cent. Teach. * FT 

(See list in Appendix A) 22? Block Teachers, $T 18 Nonpublic Teachers, FT 

5 Clerks, FT 55 Educational Aides, FT 

Total Title I Expenditures : $3,043,090 Per Pupil Cost : $742 



\ 

SUMMARY OF FINDINGS / 



All public*school groups (Grades 7-9) exceeded the attendance rate of « 
their grade level count erparts, but by less than previous years. The same groups 
failed to attain project reading objectives in seven of eight comparisons, with 
data indijating limited or no progress in 'comprehension and vocabulary for most 
groups. Block Class students attained the everyday reading skill objective but 
.not the study skills objective. Nonpublic students achieved reading objectives 
in five of eight comparisons, but all groups failed to do so -in mathematics com- 
putation; Aides .continued to make two or more contac.ts with the proposed per- 
centage of parents and each school continued to maintain an active PAQ. Survey 
results show that nonpublic staff report difficulty serving- students on a "pull- 
out" basis and that student and parent reaction to project services continues to 
be generally positive. ♦ v 

' ' A longitudinal study revealed that until two years ago, the project 
generally achieved i$s objectives. Organizational and instructional changes in- 
the last; two years '(modification/elimination of Block Classes and introduction 
of Learning Centers) have greatly increased the number of' pupils served while 
reducing per pupil costs; however, these changes have be£n actompanied by de- 
clines in achievement and attendance gains. While' other factors may be involved, 
the recent cyganizational decisions should be re-examined. 
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• OBJECTIVES AND OUTCOMES /, ,» . 

NOTE : As a preface to this review of project activities, thte reader should 
be aware of various events which affected project operations during the 
19£0 r 81 school year* 

/ As requested by the Director of Government Programs of the 
Catholic Diocese of Cleveland, Project STAR teachers in 12 
of the 19 participating nonpublic schools provided their 
students with mathematics skill reinforcement assistance in 
addition to reading skill instruction. 

. Beginning on February 17, 1981 STAR Block teachers and aides 
were no longer scheduled into the English and sociai studies 
classes of project students to collaborate with the regular 
teachers in providing classroom instruction. Instead, the 
^Blbck teacher and aide provided STAR students with one 
45-minute period daily of reading and study skills reinforce- 

' ment instruction scheduled during an elective or study hall 
period. This change was made at the direction of the Depart- 
ment of Desegregation Implementation to accommodate the ' installa- 
tion of a programmed course of study (THINK) in all junior high 
English classes and the change to a seven period school day. 

* I At the direction of the Department of Desegregation Implemen- 
tation, beginning February 16, 1981, STAR aides were no longer 
" ?i to conduct the monthly meeting of the Title I Parent Advisory 
, j - Committee in their schools. The aides were to continue to set 

* the monthly meeting dates, locate the meeting room, and notify 

STAR parents of the meeting dates, but the Project Manager of 
. Parent Liaison ^Services*, Department of Desegregation Implemen- 
tation, assumed^sole responsibility for conduct ing^the meetings, 
STAR aides, hbwever. coi|tinued^to make periodic parent contacts 
•as prescribed in the 198^81 project proposal. 

. On April 30, 4981 approximately 20 of the 22 STAR Block/Skills 
Reinforcement teachers received notices of "hon -reappointment 
for the 1981-82 school year. Such notfices were issued in res- 
ponse to declining enrollment and a predicted- budget deficit. 
Although second semester Block/Skills Reinfotcement . Class, 
organization was not ditectly affected by 'this situation, STAR 
teacher morale was influenced as demonstrated by an increased 
rate of absence among staff during the remaining two months of 
the school year. * * . 

Reactions to these events were obtained from' project staff and students; 
A discussion of these reactions appear* in the ADDITIONAL FINDINGS election 

s of this report. ; ~~ ' — ^ „ 

*• 

The achievement results cited in this evaluation report represent 
the efforts of those students who were offered a full year (38 weeks) of 
project instructional assistance. The" outcomes have been presented 

* On November S, 1980, ^the Administrator of Desegregation directed(Dir. No. 41) 
that administrative supervision of ail' compensatory education programs including 
Project STAR be transferred to the Associate Administrator of Educational Services, 
Department of Desegregation Implementation. * 
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separately for each type of instructional' treatment provided to project 
students' (i.e.., Block/Skills Reinforcement, Learning Center, and 
Nonpublic classes). The achievement of these three groups should not be 
compared because it is impossible to be certain that eligible students 
were randomly assigned to treatment group within each participating .project 
school. As a result, systematic sampling biases may be present. Appendix 
A contains a complete list of participating schools and other information 
related to t^e instructional services provided within each school. 

* ' Product Objective la: Project STAR Block Class and Learning Center 
participants will evidence a mean gain of at. least four NCE's in test 
score as reflected by pre/post Stanford Diagnostic Reading Test (Brown 
Level, Form A) scores in (1) auditory vocabulary and -(2) total reading 
comprehension. 

. Outcomes: Data indicate tfoat Grade 5 and 6 nonpublic school stu- 
dent participants attained the proposed criterion on both subtests. 
Grade 8 nonpublic school students attained the criterion 'only on 
the reading comprehension subtest, while Grade* 9 public school 
Learning Center students achieved the criterion only in auditory 
vocabulary. Block/Skills Reinforcement (Grade 7), Learning Center 
(Grades 7 and 8) and Grade 7 nonpublic school participants failed 
to attain the proposed criterion on either subtest. 

Block/Skills Reinforcement Classes - All Block Class participants 
were administered the Stanford Diagnostic Reading Test (SDRT) 
during the week of October fo, 1980 and June 1, 1981; The elapsed 
time between the two test administrations approximated 141 days with 
a total of approximately 208 hours of actual instructional time 
being offered to each participant / Table 1 provides the mean pre 
and post -NCE score and the. mean NCE gain score for. each SDRT sub- 
test administered. (Refgr to Appendices B-5 and C-5 for participate 
ing BlQck Class subtest results by school.) 

TABLE 1 

SDRT Results for Block/Skills Reinforcement Classes 





Auditory Vocabulary 


Reading Comprehension 




7 pTe 7 Post 7 NCE 


7 Pre 7 Post 7 NCE 


Gr. 


N NCE NCE Gain 


N NCE NCE Gain 


7 


249* 31.08 ' 32.04 + .96 


705 27.39 26.89 - .50 


only 







* Due. to computer programming problems, the analysis -was conducted 
on an approximate 35% random sample of those 705 students for 
whom both pre and post auditory vocabulary subtest scores were 
available. 



Learning Center glasses - The SDRT was administered on a pre basis 
to each Learning Center grade- level group during a different time 
period (i.g., Grade 7 - week .of October 20, 1980,- Grade 8-week of 

-&9- - 
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^October 27, 1980/ and Gr^de 9-week* 0 f November 3, 1*80). All 
groups, however, were administered the same test $n a post 
basis during the week of June-1, 1981. The approximate elapsed 
time between test administrations was as follows: Grade 7-141 
days or-i06 hours, Grade 9-136 days or 102 hours, and Grade 9-131 
days or 98 hours. Table 2 provides the mean pre and post NCE 
score and the mean NCE gain score for each SDRT subtest adminis- 
tered to Grade 7-9 Learning Center participants. (Refer to v 
Appendices B-6 through B-8 and C-6 through C-8 for participating 
Learning Center subtest results by<sch/ol.). 

. ■ * TABLE 2 

SDRT Results for Learning Center Classes 



Auditory Vocabulary 


Reading Comprehension 


Gr^ 


X Pre X Post X NCE 
N NCE NCE Gain 


X Pre. X Post X NCE 
N NCE "NCE Gain 


7 
8 
9 


199* 34.61 35.41 ♦ .80 
243* 36.44 34..39# -2.05 
118 -32.75 37.23# +4.48 


1 394 31.75 33.45 +1.70 
661 33.33 31.39# -1.94 
119 30.79^ 32. 47# , +1-68 



* Due to computer programming problems, thai analysis was conducted 
on an approximate 50% random Sample of the 394 Grade 7 students 
and an approximate 37% random sample of "the 661 Grade 8 students 
for whom both pre and post auditory vocabulary subtest scores 
were available. 

# Because spring norms were unavailable for Grades 8 and 9, ninth 
grade fall norms were used to interpret the post scores at these 
gfa^ levels . > v . 

Nonpublic School cjasses - All nonpublic school student participants were 
administered the SDRT during the week 0 f September 8, 1980 and May 11, 
1981. The elapsed time between the two test administrations approximated 
155 days with a total of approximately 116, hours of actual instructional 
time being offered to each participant. Table 3 provides the mean pre 
and post NCE score and the mean NCE gain score for each SDRT subtest 
administered. (Refer to Appendices B 1-4 and C v l-4 for nonpublic 
results by school.) 



TABLE 3 

SDRT Results for Nonpublic School- Cjasses 



Auditory Vocabulary 



"Gr. 



N 



X Pre 
NCE 



X Post 
NCE 



X NCE 
Gain 



49 39.87 

111 43.25 

115 41.73 

156 44.54 



50.40 +10.53 

47.66 + 4.,41 

44.81 ♦ 3.08 

47.78* + 3.25 



Reading Comprehension 



N 



X Pre 
NCE 



X Post* 
NCE 



X NCE 
Gain 



48 26.92 

^100 34.40 

113 36.91 

156 35.61 



36.33 ♦ 9.41 

44.61 +10.21 

40.13 ♦ 3.22 

40.01* +.4.40 



ERIC 



Because spring norms were unavailable for Grade 8, ninth grade 
fall norms were use<J to interpret the post scopes at this- grade 
level. y -t * ■ 



Product Objective 2a r Project STAR Block Class participants will evidence 
a significant increase (p < .05 in pre/post Everyday Skills Tests mean raw 
scores in Reading (Test A). 



Outcome: Data indicate that Grade 7 Block/Skills Reinforcement 
Class participants attained the proposed criterion, but that 
Gra^e 9-12 nonpublic school participants did not. 

The content of the EST Reading subtest reflects the instructional 
objectives which guide the project's Block social studies/skills rein-, 
forcement curriculum and the one nonpublic senior high school 
skills improvement assistance program. The criterion-referenced 
test, contains 45 items measuring the student's ability to read' 
and comprehend a message communicated by printed material as con- 
fronted in everyday life. The subtest was administered to STAR 
public and nonpublic students during the week of November 10, 1980, 
and May 25, 1981% The elapsed time between the two test adrainistra r \ 
tions approximated 116 days with a total N of approximately 168 hours 
of actual instructional time being offered to a' Block participant 
(2 periods/day) and a total of approximately 87 hours of actual 
instructional time being offered to a nonpublic participant. The 
pre and post gains were analyzed by t^-tests for correlated measures. 
Table 4 provides the mean pre and post raw score, the mean raw 
score gain, and the t^-value for the two participant grbups. (Refer 
to Appendix D-l for participating school subtest results). 

TABLE 4 * 
EST Reading Subtest Results for Block/Skills Reinforcement 
and-Nonpublic Senior High School glasses 









(45 total 


items) 


A. , 










X Pre Raw -- 


X Post Raw 


X Raw 


Treatment 


Gr. 


N 


Score • 


Score 


Score Gain t -value . 


Block 


7 


708 


25,48 


28.98 


+3 .'50 10.54* 


Nonpublic 


9-12 


28 


34.82 


35.96 


+1.14 1.56 



p <.05, two-tailed probability 
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NOTE : Although the Block Classes 1 mean raw score gain attained 
statistical significance (p < .OS), the educational significance* 
of this change is unknown because of the unavailability of norm . ' 
group data. 

Product Objective 2b: Project STAR Block Class participants will evidence * 
a mean gain of at least four NCE's in test score as reflected by pre/ppst 
.Everyday Skills Test scores in Study Skills (Test' B). 

. Outcome : The objective was not attained. 

The EST Study Skills subtest first appeared as part of the Compre- 
- hensive Test of Basic Skills, Form R, Level 3. It has two timed 
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parts: (1) Using Reference Materials*, and (2) Using Graphic 
Materials. The 20 items of Using Reference Materials* measure the 
student's ability to use library materials, The'30 items in Usfhg 
Graphic Materials emphasize the understanding and use of legends 
and symbols, drawing conclusions, and extending interpretation 

* beyond the data of a source map, diagram, table, etc. The subtest 
wps administered to STAR public school participants only during 
the week 0 f November 17, 1980 and June 1, 1981. The elapsed time 
between the two test administrations approximated 121 ddys with a 
total of approximately 171 hours of actual instructional time being 
offered. The one nonpublic senior high school (Cleveland Central 
Catholic) participating in skills reinforcement activities was not 

* included in the analysis due to the unavailability of appropriate 
grade level norms. Table 5 provides^the mean pre and post. NCE shore 
and the mean NCE gain 1 score for the Block Cl^ss groutf. (Refer to 
Appfeitdix D-2 for Block Class results By schools.) ^ 

^ TABLE S - . 

EST Study Skills Subtest. Results for Block/Skills 
v Reinforcement , Classes 

\ - X Pre • a T Post * 

Treatment Gt. N NCE Score * NCE Score NCE Gain , 

■it * f 
Block 7 668 21.80 22.81 .+1.01 

» Product Objective 3a; Project STAR Block Class and Learning Center partici- 
pants will attain an average 1980-81 attendance rate equal tQ or better than 
the.aveyage attendance rate for all 7th, 8th, and 9th grade pupils within 

~^je paHicipating schools. 

* 1 
Outcome; Data indicate, that the objective was attained by all 

Block Class and Learning Center treatment groups. 

I - * 

, An approximate one month delay occurred in the* 1980-81 opening of 
the Cleveland Public Schools for reasons associated with the 
implementation of Phase III of the system's desegregation plan. The 
school year for students officially began on September 29, 1980, and 
closed on June 30, 1981, The school year progressed without 
^experiencing any major interruptions (except for traditional vacation 
time) for a total of 180 actual Instructional days.. 

\ Table 6 presents both' STAR and non-STAR student 1580-81 school 
. * attendance rates by grade arid treatment group as well as the 

difference ifc rates between the two groups. Nonpublic school atten- 
dance comparisons could not be made due to the unavailability of .data 
for nonprqject students in these schools. (Refer to Appendix F^for * 
public school attendance -results by school.) 
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TABLE '6 



Comparison of STAR and NonSTAR Attendance ftates 
for 1980-81 



STAR Nonproject 
Treatment > Gr> N Att. Rate Atti Rate (STAR minus NonSTAR jN 

* ' Block 7 1161 • 79.33% ' 78.37% + .96% 

Learn. Cen. 7 667 79.17% 78.37% + .80% 

Learn. Cen. 8, 1028 79.0?% 76.77% +2.26$ 

Learn. Cen. 9 ^25 76.78% 74.03% +2.7S% 

Special Nonpublic School product Objective; Nonpublic Project STAR 
participants receiving mathematics skill, reinforcemnt instruction will 
evidence a mean gaih.of at least four NCE's in test score as reflected 
by pre/post CTBS (Form Q„ Level 3 or Form T, Level 3) scores' in mathe- 
matics computation. g \ 

. Outcome; Data indicate that* the proposed criterion was attained 
at Grade 7 but not at Grad$ 5, 6 and 8. 

As noted, 12 of the 18 nonpublic participating schools elected 
to provide their STAR eligible students with both 'reading and 
mathematics computation reinforcement instruction. Jhe Compre- 
hensive Test of Basic, Skills*, Mathematics Computation subtest 
was administered to nonpublic 1 student^ on a pre'basis^ during • 
the week of October 13,- 1980 and a post^basis during. 
May, 1981. Grade 5 -and 6 students' were > tested using CTBS Form * 
Q, Level 2 and Grade 7 and" 8 received~F8rm T, Level 3/ .The * 
elapsed time .between the two test administrations approximated 
126 days with a total of approximately 92 hours o£ J actual 
instructional time being offered to each participant. Table 7 
provides the mean pre and post NCE score and, the mean NCE gain 
store fox* each participating nonpublic grade level *£roup. (Refer 
to Appendix E fot nonpublic .subtest results by school.) 

jTABU? 7 

CTBS Mathematics Computation Results for 
^ Participating Nonpublic Schopl Classes 







1 Pre 


J Post 


X NCE 


Gr.- ^ 


^ >s N 


NCE' • 


NCE , 


Gain • 


5 


' 17 


41.17 


40.64 


'- .53 


6 


48 


39.68 


38.50 


-1.18 


7 


67 


<. 43.87 , 


47.95 


+4.08 


8 * 


73 


44.94 


47.16- 


. _ +2.22. - 






-;o3- 


9 


* 

s 
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. Process Objective la: The educational aide will complete a minimum 
of two home contacts ! with the parent or guardian of 80 percent of the 
STAR Block Class and Learning Center participants. 

% Outcome^ Data indicate that process objective la was attained 
by project's educational aides. A review o£ aides' parent involve- 
ment records reveals that two or more home contacts were made With 
the parents or guardians of 83% of the public school participants 
who we're enrolled in the Block and Learning Center Ciasses 
(i.e., 2,874 of the 3,463 students 1 parents). 

The type of -contact reported by the public school' educational aides 
included home visits, phone calls, school conferences, or cla5s- 

, room visits made with the parents. Such contacts weTe primarily 
initiated by project staff in an < effort to familiarize parents 
with the program's instructional rationale and the progress of 
their child's skill development. Also, parents oftentimes would 
be provided with suggestions in how to encourage and assist their 

• child t*o improve his/her reading skills. Reported contacts did 
not include >parent attendance at Parent Advisory Committee (PAC) 
meetings. As stated previously, PAC meeting activities were 
placed under the jurisdiction of the Department of Desegregation 
Implementation. Due to the absence' of aides in 17 of the 18' 
nonpublic project schools, home contact efforts were not pursued^ 
on # a systematic basis in these schools, 

. " Process Objective lb: Each ESEA Title I Project STAR junior high school 
will have 8 a Parent Advisory* Committee. 

* . Outcome: A review of educational aides 1 parent involvement data 
indicated that objective lb was attained.. 

> 

As previously discussed, STAR aides assumed responsibility for 
organizing and conducting monthly PAC meetings within their 
respective schools until January 22, 1981. After this date, - 
STAR aides assumed responsibility only for notifying parents of 
subsequent meet irfg dates and locations, while Department of 
Desegregation Implementation personnel developed the agenda and 
conducted the actual meetings. Although nonpublic schools were 
not required to establish^their own Committees, they were 
encouraged to send representative Agrents to their local district 
school and city-wide Committee meet Sags. 

*~ * 

ADDITIONAL FINDINGS 

Achievement Test Percentile Scores - The request is fffequently made 
to Relate project achievement to the national norm group. "Such a comparison 
cixi be made* through the use of a percentile, rank. A percentile rank for a 
given tqst scofe indicates the percent of pupils at '^particular grade place- 
ment in the luitional norm group #rho received scores equal to or lower than 
the given score. Table A arf3 Table 9 present the percentile rank of the 
mean- pre/post NCE scores attained by the project f s three treatment groups 

■* : . 
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on the various standized test instruments used during the 1980-81 funding 
year . 



1 TABLE 8 

Block/Skills Reinforcement and Learning Center 
Classes Percentile Rajik Results 



\ 



ul dUC 


T ae f /QnKf net' 

( i es z/ ouox.es x. 


Pre Test %-ile 


Post 


Test %-ile 


7 

Bt/Sk 
Reinf. 


SDRT Aud. Vocabulary 
SORT Read. Comprehension 
EST Study Skills 


18 . 
14 
9 


\ 


19 
13 

10 * 


7 

Lrng. Ctr. 


< 

SDRT' Aud. Vocabulary 
SDRT Read. Comprehension 


23 
18 




24 
21 

* 


* 8 
Lrng. Ctr.' 


SDRT Aud. Voc&bulary 
SDRT Read. Comprehension 


•25 

21 / 




23 
18 

) 


■ 9 
Lrng. Ctr. 


SDRT Aud> Vocabulary 
SDRT Read, Comprehension 


20 ' •> 
17 




27 
20 



\ / As shown in Table 8, all Block and Learning Center student achieve- 

ment -fell below the 33rd percentile on both the pre. test and post test. Further 
more, with the possible exception of the Grade 9 Learning Center vocabulary re- 
sults, the public school treatment groups dempnstrated limited or noipost percen 
tile score improvement in relation to the national norm 4 group within any subtest 
area. 

A review of nonpublic school result's indicated that the majority of 
Grade 5-8 po^| achievement scores approached or, exceeded the 33rd~percentile on 
each subtest 'administered. The only exceptions^ include the Gr^de S reading 
comprehension and Grade 6 mathematics computation subtest areas. Grade 5 and 
6 students were the only nonpublic school' groups tQ demonstrate no post- per- * 
centile score improvement in ^elationto tn^ national norto group 
occurred in the mathematics computation subtest area). (Re$er to Tabled 
appearing on the following page of this report). * ' % 

Longitudinal Overview of Achievement Test Results and Attendance* 
In previous STAR evaluation reports, it* has been the practice to present a 
comparative summary of public school project achievement results, over a peripd • 
of three or more years. . This summary has been introduced tQ provide an indi- 
cation of . the consistency of project treatment effectiveness in the public 
schools ^ When examining a summary of this type it is* important to note that, ^ 
although manv key variables may remain relatively constant over .the period of 



♦Nonpublic achievement and attendance data have not been included in the longi- 
tudinal overview discussion. 
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TABLE 9 

Nonpublic 'School Classes Percentile Rank Results^ 



Grade 


Test/Subtest 


Pre Test %-ile 


- Post Test %-ile 


5 


, « 

SDRT Aud. Vocabulary 
SDRT Read. Comprehension 
CTBS Math. Computation 


30 
13 
33 


50 
25 
32 


6 


SDRT Aud. Vocabulary 
SDRT Read. Comprehension 
CTBS Math. Computation „ 


37 
22 
30 


45 
38 

'29 


7 


SDRT Aud. Vocabulary 
SDRT Readi Comprehension 
CTBS Math. Computation 


34 
26 
37 


39 
31 
45 


8 


* SDRT Aud. Vocabulary 
SDRT Read. Comprehension 
CTBS Math. Computation 


39 
24 
39 


45 
31 
' 44 



years under review, changes in the project's instructional organization or other 
unforseen circumstances may have f profound impact upon participating students 1 
progress. 

Wheji reviewing STAR public school outcomes over a period of five years 
(i.e., 1976-77 through the 1980-81 school years), a number of constants can be 
identified. Thgse constants include: ' eligibility requirements for student 
participation, continued participation of Grade 7 students, project treatment 
focus on reading and study skills, utilization of the same test instrument to 
measure functional. reading/study skill progress, and acquisition of student r 
(\ vocabulary and -reading comprehension achievement data. The major changes that 

have occurred in STAR. organization took place in 1979-80 and 1980-81. In both* 
years changes involved the amount of instructional time project personnel 
offered students and the degree .of continuity in the supervision of project 
students' daily school activity. * 

The pattern of changes in achievement and- attendance results in 
'• Project STXR over the past five years is graphically illustrated in Figure 1 
V .on page 11/of thi^ report. The following review will discuss these changes 
' in relation to the changes that have occurred in project organization and 
procedures. /It should be recognized that because the evaluation design was 
not 'structure^ specifically to investigate these relatidnships, the conclusions 
that are drawn are very tentative. Despite its limitatfpns, however, such an 
analysis can serve to raise questions which warrant further investigation. 
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Until 1979-80, Project STAR was intended to help selected Grade 7 
students cope with the transition from elementary to junior high school* by 
providing them with an educational setting ^nidway between the self-contained 
classroom of the elementary school and the departmentalized organization of 
the junior high. Students remained in the same room with their STAR teacher 
(who was theif homeroom teacher) 4hd an aide for a three-period block of time 
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^ RIGURB 1 

Overview of Achievement- Test^ and Attendance Results tor School Years 1976-77 through 1980-81 




i 



1976-77 



4- 



77-78 78-79 
VOCABULARY 



8 



79*80 , 80-81 




1976-77 77-78 78-79 c , 79-80 
READING COMPREHENSION 



SO- 81 • 



—I— 



_i_ 



-J u 



1976-77 77-78 78-79 79-80 80-81 
EST STUDY SKILLS 



10 
8 
6 

3- 

8 0 

i~ 2 

i 6 
8 
10 





1976-77 .77-78 78-79 79-80 80-81 
EST READING 



1976-77 77-78 78-79 79-80 80-81 
ATTENDANCE 



T 



KEY 

Grade 7 Block/Skills Reinforcement Classes 



•'• Grade 7 Loaming Center Classes 
-o Grade 8 Learning Center Classes 



from one 



X Grade 9 Learning Center Classes 

- 1 * Major Change in Block/Skills Reinforcement Class Ins tructional Treatment 

1 979- 80 Both reading/English and social studies/skills reinforcement ^Aftaes increase, 
to two plriods . Team Leader and aide assists students a total of five poriods per day. 

1 980- 81- During the first semeste^, both rcading/Englisti and fcocial studies/skills reinforcement 
classes reduced from two to one poriod each. During tho second semoster, *he Team Leader and aide 
provide a total of only one period of reading/skills' reinforcement assistance daily. 
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each day during which they received instruction in English/reading, social 
stu4ies, ^ mathematics. During the mathemetics period, ^the STAR teacher 
was assi^^d by a certificated mathematics .teacher. Students slso received a 
fourth p^iod of' instruction in study skills from their STAR teacher later 
in the, a$y'. As a result of this, organizational plan, the typical STAR stu- 
dent^ d£ily school activity was primarily supervised by one STAR teacher and 
aide, 4 plan designed to lend Continuity to the supervision of the student's, 
school activities. A typical daily schedule of project activities of a par- 
ticipating STAR Block student prior to, 1979-80 is illustrated in Figure 2. 



FIGURE 2 

STAR Slock Cl*s« Orfiziizitioa (1976-77 Through 1978-79) 
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An indication of the progress students made while participating 
in the 1976-79 organizational structure can be obtained by referring to Figure 
appearing on page 10. Upoiv reviewing the graphs, the reader will note that 
achievement and attendance progress of Block students during* 1976-77 through 
1978-79 declined slightly in most -achievement subtest areas as well as in atten- 
./ dance. The only exception to this pattern occurred in the EST Study Skills area 
were a sharper decline in mean NCE gain score took place. Despite these de- 
clines, however, achievement and attendanqe gains exceeded or approximated the 
proposed objective criteria. Student reading progress during these years was 
measured using the Cpnprehensive Test of Basic Skills, Form T*or S, Levdl 3. 
(Refer to Appendix 6 for complete mean pre and post test score\data, attendance 
rates, and STAR treatment descriptions.) ' * 

For 1979-80 changes were mide in the program which increased the amount 
of, redding- instruction, but wli^ch also decreased the continuity of staff super- 
vision of the student's school activity by breaking the instructional day irrta 
blocks taught by different teachers v Mathematics was discontinued as a proAct 
emphasis. , y ' \ - 

Students were scheduled into a double period of English /reading and a 
'double period of social studies/study skills instruction. The tw6 double* periods 
took place in different rooms and generally at different times during the .day. 
While attending the double English/reading period, students were instructed by 
a STAR English teacher and an aide; however,' students were ''pulled out 11 on a 
staggered basis for one period of reading instruction in a separate Learning 
Center staffed- by another STAR teacher and aide for a total of 90 days each . 
r during the year. While attending the double social studies /study skills period, 
x students were instructed by a third STAR teacher and aide for one period of 
social studies and one period of study skills. During the social studies period, 
the STAR teacher was assisted by a non-project social studies teacher. Later in 
• the day, students attended a "vocational. skills reinforcement class," which was 
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a home economics or industrial arts class taught by a non-project teacher 
assisted by one of the student's STAR teachers and aides. Either the STAR 
English* teucher or the STAR social studies teacher also served as the stu- 
dent's homeroom teacher. Figure 3 shows a typical daily schedule for a STAR 
Block student in 1979-80. 



FIGURE 3 

1979*30 STAR Block Claas Organization 
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Also in 1979-80 a separate Learning Center program was established 
for students^ in Grades 7, 8 and 9 who did not participate in the Block Class. 
These students attended one period daily of programed reading instruction in 
a Learning Center staffed by STAR teacher and aide. 

• By referring to Figure 1 , the reader will note that accompanying the 
1979-80 increase in time devoted to reading instruction, a substantial mean 
NCE gain score increase occurred in the reading subtest areas (i. £. , vocabulary 
and reading comprehension). The gains recorded in these areas exceeded the 
proposed objective criteria. (It should, however, also be noted that at the 
beginning of this school year the CTBS test ft^trltaent was replaced by the 
Stanford Diagnostic Reading Test, Brown Level, Topa A.) The gain score recorded 
in the EST study skills area continued to decline, while the EST reafcng score 
closely approximated the previous year's outcome. The time, however, devoted 
to social studies/skills reinforcement instruction failed to increase as dra- 
matically as in reading. Also, it Should be noted that accompanying the de- 
crease of continuity in student supervision, a sharp decline was demonstrated 
in the students 1 attendance rate.* Finally, the 1979-80 school year witnessed 
the initial opening of the project's Learning Centers. Grade 7 and 8 Center 
participants, however, demonstrated limited or no progress in reading as 
evidenced by their gain scores. Learning Center participant attendance rates 
were also dramatically less in comparison to non-project students in the same 
grades. (Refer to Appendix 0 for complete mean pre and post test score data, 
attendance rates and STAR treatment descriptions .) 

For 1980-81 further changes were made which decreased the amgunt of 
reading instruction and further reduced- the amount of direct supervision of 
students by the STAR staff. STAR teachers, for example, no longer served as 
homeroom teachers for STAR students. Grade 7 Block students were taught one- 
period each of English and social studies by non-project teachers assisted 
by a STAR teacher and aide. These classes were scheduled consecutively in 
the same roonr. Students continued to receive one period per day of study skills 
instruction from the STAR teacher and aide, but maximun class size was increased 
from 25 to 30 students. Learning Center students, who did not participate 
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* Attendance rates also may have been influenced by the massive reassignment of 
students called for in Phase II desegregation implementation plan which 
was initiated on March T7, 1980; in all junior high school*. 
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in the modified block schedule, received one period daily of programmed read- 
ing instruction in a Learning Center staffed by a STAR teacher and aide for 

the entire year. • ' 

* 

Effective the second semester of 1980-81 further changes were made. 
STAR teachers and aides no longer assisted the non-project English and social 
studies teachers in providing instruction, in those subjects tq STAR Block 
students. STAR teachers and aides continued to provide one period daily of 
study skill instruction to STAR Block students. • Figure 4 illustrates the 
typical daily schedule of activities for a Block Class participant during 
each semester of the 1980-81 school year. 
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FIGURE 4 

1980-81 STAR Block Class Organization 
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By referring to Figure 1/ the reader will note that accompanying the 
substantial decrease in time devoted to Block Class reading instruction during 
the 1930-81 school year, a drastic decline in gain scores occurred in both 
reading subtest areas. Bldpk students demonstrated limited progress in the 
vocabulary subtest area and no progress in the reading comprehension area. 
^Also, EST Subtest gain scores continued to .decline. * 

The reader should be reminded that the April 30, 1981, issuance of 
lay-off notices for tKe" following year to most Block teadiers may also have 
influenced student^performance. 
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Despite the fact thaj by the end of the first semester the. Block 
teacher supervised the activity of their STAR students for one period per 
day only, >lock. participants did evidence a slight improvement in their 
school attendance ratfe relative to their Grade 7 student counterparts. 

Although Grade 7 tod 8 Learning Center participants were unaffected 
by the organizational changes encountered by their Block Class counterparts, 
the two groups continued to demonstrate limited or no progress in reading as 
evidenced by their gain scores. Both groups' attendance rates, however, evi- 
denced a dramatic improvement relative to their grade-level' student counter- 
parts. (Refer to Appendix G for complete mean pre and post test score datfc, 
attendance ra^es, and STAR treatment descriptions. y 

To summarize \ the longitudinal analysis indicated that as major 
changes were made in the project's organization, changes were npted in stu- 
dent achievement and at tendance. K With an increase in the amount of reading 
instructional time in Block Classes, students' reading achievement appeared to 
improve s Conversely, as readiiig instructional time in these classes was re- 
duced, achievement appeared to decline. The introduction of ,a new instruc- 
tional approach (Learning Centers), which is apparently designed to replace 
the Block Class approach, has produced little improvement in student achieve- 
ment. Additionally, STAR student attendance rates traditionally exceeded that 
of all students during the time when project teachers assumed responsibility 
of supervising the activity of not more than 2S students from homeroom through 
the major portion of the remaining school day. With the fragmentation in the 
STAR Class schedule anfr in the teacher' A inability to provide .cdntinuity during 
the students' school day/ attendance rates of project students began to resem- 
ble those^ attained by their grade level counterparts. Although it is possible 
that variables other than the organizational and instructional changes of the, 
past two years have contributed to the changes m achievement and attendance 
(teacher lay-offs, start of busing, etc.) the relationships which appeared to ' 
surface in this analysis warrant 1 the close attention of project management. 

< « 

Project Cost Comparison From 1976-77 through 1980-81 - During the 
same period covered by the longitudinal analysis of achievement and atten- 
dance, the project demonstrated a rapid increase in the number of pupils 
served and a decrease in the per pupil cost of delivering project services. 
Figure 5 on the following page shows for the past five years of operation the, 
pattern ef changes in both these variables. 

The figure shows that, accompanying the organizational changes that 
were mad$ in the prqject,.the number of pupils served increased over four- 
t fold and the per pupil tost was reduced by over 25%. Appendix H presents the 
number of pupils served, the total project expenditures and the per pupil cost 
for ^ach of the years 1976-77 through 1980-81. 

Survey of Public School STAR Staff , Parents, and Students* - Efforts 
were made. to ascertain ^how various groups viewed their involvement in 1980-81 
project activities. To accomplish this, a variety of specific questionnaires 
were develdfcied to obtain the perceptions of those who- Had direct contact with 




# Refer to Appendix I far further details regarding survey findings. 
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FIGURE 5 



Pupils Served and Per Pupil Cost in Project STAR 
• from 1976-77 through 1980-81 
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project services. Those questionnaires were distributed to .project, staff , 
studprfts and parents in June of 1981. The following highlights the major 
findings obtained from the responses of 16 Block Team Leaders, 26 learning 
Center teachers, 40 educational aides < S03 parents, 248 Block students, and 
338 Learning Center students. , 



. A majority of the 42 responding STAR Block and Learning Center 
teachers (64%) indicated that they "encountered difficulty schedul- 
ing students" into their project classes at the beginning of the 
school year. This finding represents a slight increase from the 
previous year when 57% of the teachers responded to the- same question 
in a similar manner. Both Block and Learning Center teachers appeared 
to be equally affected by the problem. Respondents continued to re- 
port having to locate eligible students who had study hall assignments 
or elective class periods and re-schedule this, time for participation 
in project activities. This disruption ^continues to prevail because 
•STAR classes N are not programmed into the master school schedule prior 
to the'beginning of the school year. These scheduling problems appear 
to have an extremely detrimental effect on participant student atti- 
tudes. Most teachers report that students strongly object to being 
removed from their previously scheduled elective classes. This resent- 
ment reportedly lingers for several weeks among many students making 
-it-difficult for staff to obtain the i r c ooperation. ■. 
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When Block teachers were asked what effect the second semester organi- 
zational change had Vn the quality of instructional assistance that 
could be provided to their studentS (i.e. , changing from Block to Skill 
Reinforcement classes), a majority (or ,62%) of the 16 respondents in- 
dicated a "very positive" or "positive" rating, 6 percent reported J 
that the change had "no effect," and 19 percent failed to respond to 
the question. 

When responding, teachers who indicated a positive rating appear&Pto 
consider the question in terms of their ability to plan instructional 
activities that addressed the unique needs of each student. Most re- 
ported that acting as instructional assistants in the students' regular 
English and social studies classes during the first semester afforded 
them little time to develop individual instructional prescriptions 
for students. During the second semester, their total instructional 
time was spent performing project, duties designed to meet the individual 
needs of their students. The Block teacher respondent indicating a 
negative rating tended to comment that the second semester change 
lacked organization and clear operational objectives. 

Sixteen (or 61%) of the 26 responding Learning Center teachers indi- 
cated that "the amount of time students were required to attend the 
Center (i.e,, 45 minutes daily during the«ejitire school year) was v 
"about right". A substantial number of the remaining respondents 
(8 individuals, or 35%) indicated "much too much time" or "a little 
too much time" was being scheduled. When asked to 'explain their 
rating, this. latter group of respondents reported that their stu- 
dents tended to tire of the fab format after the first semester. 
Th$y attributed this reaction, to the lack of variety in the labs' ' 
teaching materials and jformat. One individual reported supplementing 
lab instruction with activities outside the regular format as weU as 
making attempts to find ways to introduce more relevance to the stu- 
dents' lab work and school assignments; The use of such approaches 
reportedly helped to maintain Learning Center student interest through- ' 
out. the year, 

A variety of comments was obtained from 5 the responding project 
^teachers (N=42) when asked for their suggestions regarding how pro- 
ject services can be improved, "The following suggestions were among 
those cited most frequently: relate project instruction more sper 
cifically to students' classroom subjects; re-establish project ] 
efforts aimed at obtaining the active involvement and interest of 
parents; insure that Project STAR is incorporated within the master 
school schedule; motivate student learning by awarding grades which 
would appear on student report cards; and increase ability of project 
staff to work with their students during a greater portion of the 
school day (e.g., restore STAR homerooms, utilize more block schedul- 
ing, establish working relationships with guidance counselors). 

Responding educational aides (N»40) appeared to reiterate many of the 
same concerns held by their project teacher colleagues when asked to 
indicate "the greatest problem" they have encountered in their duties. 



Approximately one out of every four respondents indicated not being 
able to obtain the involvement of project parents. Suggested ways of 
improving parental interest included resuming the responsibility of 
conducting home visits (as opposed to making only home contacts),; 
sponsoring a program at the end of each semester to discuss the> pro? 
gress made'by students; re-establishing the project's^ direct relation- 
ship with the Parent Advisory Committee (PAC) ; and requesting greater 
involvement of the Desegregation Community Coordinator in all PAC 
meetings. * The second most frequently cited problem encountered in- 
volved the lack of student interest or motivation in learning (*Approxi-, 
mately 20% of the aides 1 cited this problem .) Recommended actions to 
deal with this problem included: assigning a STAR grade on the stu- 
dent's report card; obtaining more interesting instructional material; 
providing greater variety in the instructional format of the Learning ' 

Center. 

. An overwhelming majority (81%) of the 503 responding parents indicated 
vthat they felt their child tfas doing u much better 11 or "somewhat better 11 
in reading this year in comparison to the previous year. Of the re- 
maining respondents, 17 percent indicated that their chijld**was doing 
"about the same 11 and 2 percent responded "somewhat worse? 1 or "worse." 
Most Respondents believed that their child was "very satisfied" or 
"more or lesS satisfied" with the STAR class during the first semester 
(i.e., 78% responding in this manner) as well as the second semester 
(I.e. , 82% responding in this manner). Those responding "undecided" 
changed little for each semester (i.e., 14% and Irrespectively) as 
did those who indicated "more or less satisfied" and "very dissatif- 
fied" (i.e., 7% ,and 5%, respectively) . 

*. Block/Skills Reinforcement "student respondents (N±248) appeared to 
be less positive about their involvement in the project than did their 
Learning Center counterparts (N*338). When asked, for example, whether 
being in the STAR class "helped me do better in my regular classes/ 1 
a "strongly agree 11 or "agree more than disagree" response was recorded 
by 60 perqent of the Block students versus 70 percent of the Center re- 
spondents. A similar breakdown in response was indicated when students 
v were asked whether the STAR teacher did a "good job in teaching me how 
tb rea4" (72% vs. 82%) and whether they were "reading better this year 
than list" (79% vs . 82%) . This same response pattern appeared to be ^ 
operating when respondents were* ask$4 if they were' "glad to be in a 
STAR class." A smaller percentage of both groups, however, indicated 
a positive response t;o the question (44% vs. £9%). The remaining re- 5 
spondents in the two groups indicated a "not sure" response (23% v§. 
17%) or negative response (32% ys. 23%) to the latter question. 

Survey of Nonpublic Schpol STAR Staff, Parents, gad Students* 

i * " 

. A majority of STAR nonpublic school teacher respondents. 53%, or 

8 of the 15 respondents) reported encountering difficulty scheduling 
students into their project classes. yiwm, asked to describe the 
t difficulties, the most common response related to the "pull-out" pro- 
* cedure implemented in all- nonpublic schools. This procedure entailed ? 
removing eligible STAR students from their regular class-room assignments 
'and providing small groups of these students with reading and/ or mathe- 
matics instructional support . STAR teachers who encountered scheduling 
difficulties were oftentimes confronted with the resentment of 

* ftefer to Appendix I for further details regarding survey findings. 
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regular classroom teachers who viewed project assistance as an 
interruption in the students 1 regular classwork, This resent- 
ment was especially evident in schools vhere the same students 
were assigned to more than one Title I project. In one School, 
a teacher respondent indicated that STAR participants resented 
being selected to receive project services, because they were 
made to ?, make-up" material that they missed during their regular 
class assignments. 



Three out of #very four nonpublic teachers (11 of 15) cited either 
the variety of project reading materials or the opportunity to 
individualize student instruction as being the single feature of 
the project which has contributed most to improving student learn- 
ing. The most- common response made by teachers when asked to 
identify the factor contributing least to student learning related 
to the negative impact the "pull-out" procedure has on students. 
Typical comments related to this particular finding included: a . 
poor student had to miss his regular class too often when receiv- 
ing project assistance; students resented missing art and movies 
when attending a STAR class; and teachers used the .fact that stu- 
dents are missing regular classes to award failing grades/ This 
factor may also have contributed to teachers 1 reporting that many 
of their students lacked interest and motivation. 



As did their public school counterparts, nonpublic school parent 
respondents (N*229) appeared to possess extremely positive percep- * 
tions of Project STAR '-services An overwhelming majority of the 
respondents (88%), for example, felt that their child was doing"much 
better" or. "somewhat better" in reading this year than last year. Of 
the remaining respondents,, 8 percent indicated an "about the same" rat- 
ing, i percent a "somewhat worse" rating; pnd 3 percent failed to 
respond to the question ♦ A slightly smaller percentage of parents 
(83%) indicated that the .STAR class was doing a 'Very good" or "good" 
job in educating my child, * A"fair" job fating was reported by 14 
percent of the respondents, "poor job" by 2 percent, ana I percent 
failed to respond. 

Nonpublic students responding to a survey questionnaire (N*456) 
appeared to reiterate the positive perceptions indicated by their 
parents with respect to project services. When asked, for example, 
if they believed that /they were "reading better this year than last^ 
year," an overwhelming majority "strongly agreed" or "agreed more 
than disagreed." *Remaining respondents indicated eithefa "disagree 
more than agree" or "strongly disagree" response (4%), a "not sure" 
response (11%) or failed to respond (1%) ♦ A similar response pattern 
was demonstrated when students were asked if they were "glad to be in 
a STAR class." A majority of students. (70%) indicated *a "strongly 
agree" or "agree more than disagree" response, 18 percent indicated 
a "sffrongly disagree" or "disagree more than agree" response 11 per- * 
cent indicated a "not su*e" response, and 1 percent failed to respond 
to the question. 



CONCLUSIONS 



A summary analysis of 1lM0-8l Project STAR results revealed the following 
outcomes./ After a one-year setback all STAR .groups again exceeded the atten- 
dance rate of their grade-level counterparts, but such rate differences were 
lower than previous years. Unlike most of the previous years, STAR student 
groups failed to demonstrate attainment of the proposed reading objective 
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criterion (except Grade 9 Learning Center students in vocabulary), with 1980-81 
achievement data indicating limited or no progress in Comprehension and Vocabul- 
ary for most groups. Block Class students continued to attain the proposed EST 
Reading subtest criterion^but failed to do so on the EST Study Skills subtest* 
which continued a pattern of decline observed over the past five years* Non- 
public student groups achieved the proposed criterion level on reading subtest 
objectives in five out of the eight compassions, but all ^groups failed to do 
so in the mathematics computational areay Educational aides^continued to make 
two or more contacts, wit lv^e^3^pa^d--per cent age of parents specified in the. 
proposal, while each schoot""corriinued to maintain an active P AC throughout the 
school year. 

Additional analyses presented in this report revealed a dumber of other 
outcomes. Included among these were the following. When 1980-81 student achieve 
ment results are compared with national norm groups, STAR public school students 
demonstrated extremely limited progress, while nonpublic school students gen- 
erally demonstrated more substantial progress in reading, but limited progress 
in mathematics. Longitudinal findings raised the possibility that the organiza- 
tional and instructional changes made during the last two years may have been 
; among the factors contributing to the decline in achievement and attendance 
results. A five year comparison of project costs revealed that the project demon- 
strated a rapid increase in the number of pupils served and a decrease in the 
per pupil cost of delivering project services. Public school staff questionnaire 
results indicate a general dissatisfaction with the discontinuation of mapy 
aspects of the project's former organization. Nonpublic staff continue to find 
it difficult tb serve students on a "pull-out 11 basis % Student and parent reac- 
tion to prdject instruction continues ta be generally positive* although Block 
students appeared to be less positive than their Learning Center counterparts. 

Based .on an extensive review of current (1980-81) as well as past 
years (1976-40) project- related data, this evaluat or provides the following 
recommendations for consideration when making future operational planning 
decisions. 

. The previous STAR evaluation report ^1979-80) prepared by this 
evaluator indicated that school administrators were contemplating 
the elimination of the Bff>ck Class format and replacing it with 
the Learning Center organization 'during 1981-82. This evaluator 
cautioned those making sue* decisions that nothing in the avail- 
able data indicated that such Centers do a bette&job in promot- 
ing reading skill development and that, in fact, the available 
'data suggested the reverse. The recommendation feft|ed with the 
1 suggestidn that permanent changes 'in STAR organization should be 

thoroughly reviewed. Those recommendations Still stand. As noted 
in this report (1980-81)/, Block Class organization was virtually 
eliminated in February of 1981. Although many variables may have 
contributed to the general decline in student achievement and 
attendance outcomes, a review of longitudinal data suggests that 
* project organization and instruction changes made in the past 
two years could be involved. If the' project intends- to remain 
a viable instructional entity, it is imperative that program 
management re-examine these changes to determine if they aid 
^ or hinder student achievement. 



The analysis of project costs presented in this report indicated 
that a steady increase in the number of students served by' the 

i.project has occurred over a five year period, while the ampunt of 
project funds spent per pupil has declined. N Although it, is 
important to impact as many eligible students as possible with 
Jprblect services, spreading monetary resources too thinly may 
contribute -to weakening instructional effectiveness. It is 
essential that future decisions regarding the number of pupils 
that .the project should serve be examined with respect to providing 

.the optimum level of instructional effectiveness* v 

A number of Learning Center teachers (8 of 27, or 30%) responding' 
to a questionnaire* indicated that students generally appeared to 
"tire 11 or "get bored 11 with the Centers 1 instructional approach 
after the completion of' the first semester. One teaqher attri- 
buted this behavior to the fact that" "there wasn't etaough variety 
in the program, while another found it "necessary to do mpre 
activities outside the New Century program The latter respon- 
dent indicated that providing j'more relevance to other school 
work helps the students understand .the significance of the lab 
work. 11 In an effort to pitovide an environment which encourages 
students to perform at their maximum potential, program manage- 
ment should further investigate the basis of the above observa- 
tions. A study designed to ascertain' the optimum _period of time 
a student should participate in the Learning Center may also 
provide information that can be used to increase the potential 
impact of Center serviced. 

As reported in past project evaluations, numerous public school' 
STAR staff continue to recommend that the scheduling of project 
students be accomplished prior to the start of the each school 
year to insure that participants receive the maximum amount of 
instructional services. Many teacher respondents indicate that 
studehts resent being taken from scheduled classes to attend ' 
project classes. This resentment tends to produce uncooperative 
learning behaviors in students. Previous evaluation recommenda- 

* tions have urged that an automated scheduling procedure be e 
introduced. This evaluator is aware that the project manager . 
has diligently pursued accomplishing this goal for a number of * 
years, but has been unsuccessful in obtaining programming status 
for the oroject.* It is once again urged that such scheduling 

v procedures be developed ^prior to the start of the 1981-82 school * 
year. 

A number of public school £taff (both teachers and aides) have , 
provided unsolicited comments on their questionnaire surveys re- 
garding the noticeable lack of parent involvement in the STAR pro- 
ject. As noted previously in this report, aides were no. longer 
responsible for conducting monthly PAC meetings in^thsir buildings 
due to the fact that Parent Liaison Services assumed responsibility 
in February of 1981. In addition, at the end of the 1977-78 " 
school year, ptoject management terminated the practice of requir-^ 
ing aides to conduct home visitations. Although supportive data J 
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is unavailable, the loss of activities that brought parents 
and project personnel together on a pumber of occasions through- 
out the school year may have been one moffe factor contributing - 
to the noted decline in student achievement. Prorgram management, 
in cooperation with the project manager of Parent Liaison Services, 
should explore alternatives that will restore the close contact 
Project STAR personnel previously had with pSrents. % 

A review of nonpublic school staff questionnaire responses re- * 
veals that the "pull-out" procedure utilized* to service project 
students may create friction with teaching colleagues* Further- 
morefc, it is reported thfct students are qftentimes penalized for 
missing regular classwork as a result of> having to participate % 
in Project STAR activities. In efforts to insure ,'the optimum 
cooperation of the entire" school staff and obtain the interest • 
of student participants, it is recommended that program- manage 
"ment investigate possible alternatives to mihimize such disrup- 
tions ^ >> 
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APPENDIX A 

A Listing of 1980-81 Participating 
Public and Nonpublic STAR Schools 
and Information Related to 

Instructional Services 
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APPENDIX A-l 

PROJECT STAR DEMOGRAPHICS 
• # * 1980-31 

*» 

Participating Public Schools and 

No. of Components Within Schools ^ » * 





^onponcn t 


Block 
Classes 


Learning Center A 
New Century Read 


Learning Center C 
Hoffman Learn. Cent. 


Learning Center B 
Educ. Dev. Lab 


_ ' Grade 
^ Partic. 




'7th - 9th 


7th - 9th 


7th - 9th 


A. B. Hart 


1 


N 1 




-Je ; — r 

J 


A. Hamilton 


. 1 




1 




Audubon 


\ 1 y 


1 


— . 1 


> 


^Central 


1 


- 

• 1 ( 


1 




C} Shuler 


1 




1 




C. Mooney 


1 




1 




C. Eliot 


« 1 




1 




C; Westropp 


1 




1 




.Empire 




1 




4 


F. D. Roosevelt 


1 


1 


1 


— 1 — 


H. Davis 


1 


1 




\ 


J. Gallagher 


1 - 


1 






Lincoln 


' i 


1 


1 


- 


M. Spellacv 


l 


1 


/ 




M; L. King 


l 


— V 


_ . 




M. Herrick 


l 






— ' . •• 


N. Hale 


x 




x » 




N. Baker 


r 






1 


P. Henry 


i 


1 


- 1 




R. Jamison 




2 






T. Jefferson 


i 


1 






W. Young 




t 




l 


W. Wright 


i 








Vinson 


i ~ 


1 






TOTALS 


22 „ 


^ 18 


12 ^ 




* * 
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APPENDIX A- 2 

PROJECT STAR DEMOGRAPHICS* 
1980-81 

Participating Nonpublic Schools 



j. 



h Immaculate Conception 
Our Lady of Good Counsel 
Sacted Heart of Jesus' 
St. Adalbert 
'St. Benedict 
St. Boniface 
St. Catherine 
St. Francis 



St. Ignatius 
0 ✓ 



St. Jerome 
St. 'John Nepomucene 
St. Joseph Franciscan 
St. Leo 

St. Phillip and James 
St, Phillip 'Neri 
St. Stephen 
St. Vitus 
Urban Community 



<<3 



eric 



im 

4 



-122- 



* 



APPENDIX B 

Title I Project STAR Stanford Diagnostic 
fccading Test, Vocabulary Subtest Results 
For 1980-81 
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APPENDIX B-l. 

1980-81 Stanford diagnostic Rending 
Test Results Cox Grade 5 Nonpublic 
Classes 



VOCABULARY' 



.School 

Inaculato Conception 9 
(Xir Lady of Good Counsel 
SacTed Heart of Jesus 



X Pre NCE X Post 

N (Pall Norms) (Spring norms) 



9 
3 



50.33 
41.00 



60.00 
&.00 



Urban .Conamity t 



Grand Total 



49 



39.87 



50.40 



Actual 3 Objective 
NCE Gain* Attained 



♦ 9.57 

♦ 2.00 



'Adalbert ^ 
Benedict 9 


1 


52.00 


64.00 


♦12.00 


## 


Boniface $ 












Catherine • 












Francis 


5 


32.00 


29.20 


♦ 2.80 




Ignatius 9 






m 






Jerome • 




> — 








John Nepomucene 


6 


35.00 " 


50.83 


♦15.83 


*# 


Joseph Franciscan • 












Leo* | 


P — 






* 




Phillip and Jaaes 


8 


41.37 


44.00 


♦ 2.63 




Phillip Neri 


11 


36.54 


53.18 


♦1«.64 


** 


Stephen » 


6 


37.16 


58.16 


♦21.00* 


** 


Vitus • 













♦10. S3 



** 



•The Stanford Diagnostic Reading Test, Brown Level; Form A, was administered to fifth 
grade participants during the weeks of September 8, 1980 and May 11, 1981. 
-^#An NCE Standard Score Cain which is one-third of a Standard Deviation (i.e., a 7.00 

NCE gain or more) is considered to bo educationally significant. *~ ~ 

# *0bjcctivo criterion - at least a 4.00 NCE mean gain. 
•Did not servo Grade 5 students. 



-IK?. 

.123 



APPENDIX B-2 

1980-S1 Stanford Diagnostic Heading 
Test Results for Grade 6 Nonpublic 
Classes 



VOCABULARY* 



Schools w 


n 


X Pre NCE • 

all IWlUlSJ 


I Post 

^opting jiuiuio^ 


Actual 3 


Objective 


Immaculate Conception 


4 


51.25 


55.50 


♦ 4.25 


** 


Our Lady of Good Counsel 


9 


46.55 


47.33 


♦^.78 




Sacred Heart of Jesus 


2 


54.00 


55.00 \ 


♦ 1.00 




7 

St. Adalbert V 


' 8 


39.00 


36.50 


- 2.50 


- 


St. Benedict 


3 


48.33 


59.66 


♦11.33 




St. Boniface 


12 


40.50 ; 


44.58 

< 


♦ 4.08 




St. Catherine 


A 

0 


00.5/ 


07 • O / 


♦ 3 00 
▼ . w 




St. Francis 


4 


31.75 


30.50 


- 1.25 


• 


St. Ignatius • 






\ 

• \ 

4 


• 




St. Jerome 


7 


49.71 


52.42 


♦ 2.71 




St. John Nepomucene 
St. Joseph Franciscan • 


. 12 


40.66 


52.16 

• 


♦Iris SO 




St. Leo 


14 . 


49.78 


• 68.8$ 


♦19.07 




* 

St. Phillip and James 


7 


46.57 


43.00 


- 3.57 




St. Phillip Neri 


4 


34.50 


53.50 


♦19.10 




St. Stephen 


11 


40.00 


33.18 


- 6.82 




St. Vitus 


6 


«e 


41,50 


♦ 3.00 




Urban Community^ 












Grand Total 


111 


43.25 


47.66 


♦ 4.41 





•The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to '.sixth 
grade participants during the weeks of September 8, 1980 and May 11, 1981. 
f An NCE Standard Scoro Gain which is one-third of a Standard Deviation (i.e., a 7.00 
NCE gain or more) is considered to be educationally significant. 
••Objective criterion - at least a 4.00 NCE mean gain. 
•Did not serve Grade 6 students. v 
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APPENDIX B-3 



School" 

Immaculate Conception 
Our Lady of Good Counsel 
"Sacred Heart of Jesus 
St. Adalbert 
" St. Benedict 
Boniface 



^St. Boni 
Sit. Catherine 



\ 



1980-81#Stonford Diagnostic Reading 
Test j/csults for Grade 7- 4 Nonpublic 
7 Classes % 



St. Francis 
St. Ignatius 
St. Jerome a 
St. Jchn Neporaucene 
St. Joseph FranciscanCb^ 12 
St. Leo 

St. Phillip and James 
St. Phillip Neri 
St. Stephen 
St. Vitus , 
Urban Community 



VOCABULARY* 

X Pre NCE 
n CTall Norms) 

6 35.83 
3 45.66 

3 39.00 

8 ^ 40.50 

6 ^ 52.50 

7 32.42 

9 38.44 

4 6 32.00 
12 51.83 

39.25 

7 39.00 
* 33.50 
4 61.25 
3 50.33 
' 5 49.00 
11 41.09 

3 36.00 

4 44.50 



X Post 
(Spring norms) 

37.16 
51.00 
•34.66 
44.50 
58.50 
37.14 
40.11 
.33.00 
50.25' 
"44.37 
39.14 
37.25 
51.25 
52.00 
68.40 
47.00 
42.00 
48.00 



Actual \ 1 Objective 
NCE Gainff Attained 

♦ 1.33 

♦ 5.34 ** 

- 4.34 

♦ 4.00 ** 

♦ 6.00 ** 

♦ 4.72 ** 

♦ 1.67 

♦ 1.00 

- 1.58 

♦ 5.12 ** 

♦ .14 

♦ 3.75 
-10.00 

♦ 1.67 

♦19.40 ♦* 

♦ 5.91 ** 

♦ 6.00 ** 

♦ 3.50 . , 



Grand Total 



115 



41.73 



44. 



♦ 3.08 



*Tho Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to seventh 
grade participants during the weeks of September. 8, 1980 and May 11, 1981. 
#An NCfcStandarJ Score Gain which is one-third of a Standard Deviation (i..£.» a 7.00 
« MCE gain or norc) is considered to be .educationally significant. 
•♦Objective criterion^- at least a 4V00NCE acan gain! 
(b) Did not receive the services of a project teacher. Instruction was provided by a 
rull-tiae educational aide; 
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APPENDIX B-4; 



1980-81 Stanford Diagnostic Reading 
Test Results for Grade 8 Nonpublic 
Classes * v * 



School 



Immaculate Conception 



8 
16 
7 



Our Lady of Good Counsel 
Sacred Heart of Jesus 
St. Adalbert % 

St. Benedict 12 

St. Boniface 2 

St. Catherine 11 

£t. Francis 3 

St. Ignatius 23- 

St. Jerome 19 

St. John Nepomucene 7 

St. Joseph Pranciscan(b) IS 

St. Leo 13 

St. Phillip and James 8 

St. Phillip Neri 3 
St. Stephen • 

St. Vitus S 

Urban Commit/ 4 



VOCABULARY"* 

X Pre NCE 
(Fall Norms) 

34.00 
58.62 
33. 57 

42.58 
\ 38.50 

42.09 

38.66 
' 48.65 

46.00 

49.14 

36.20 

51.23 

45.12 
- 39.33 

32.60 
37.25 



TL Post 
(Fall Norms) ## 



38.87 
64.18 
33.42 

48.9.1 
37.00 
45.81 
32.66 
49.52 
48.94 
54c65 
36.20 
57.23 
51.12 
36.66 

35.60 
'45.75 



Actual X Objective 

NCE Gaintf Attained 

♦ 4.87 ** 

♦ S.56 ** 
- .15 



♦ 6.33 

- 1.50 

♦ 3.72 

- 6.00 

♦ .87 a 

♦ 2.94 

♦ 5.71 
- 0 - 

♦ 6.00 

♦ 6.00 *v 

- 2.67 

♦ 3.00 

♦ 8.50 



Grand Total 



156 



44.54 



47.78 



♦ 3.25 



V 



•The Stanford Diagnostic heading Test, Brown Lcvdl, Form A, was administered to eighth 
grade participants during the weeks of September 8, 1980 and May 11, 1931. 
>#An NCE Standard Scoro Gain which is one- third of a Standard Deviation (i.e., a 7.00 

NCE gain or wore) is considered to be educationally significant. 
•^Objective criterion - at least a 4.00 NCE mcca gain. 
•Did not serve Grade 8 students.- 

IfBecause Spring norms are not available at the eighth grade level, ninth grade Fall norms 
- were used to interpret eighth gTade pos t)f scores. 

(b)Did not receive the services of a project teacher? Instruction was provided by a full-time aide. 
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APPENDIX B-S 

1980-81 Stan|ord Diagnostic Reading Test Results 
for Grade 7 Block/Skills Reinforcement Classes 

-AUDITORY VOCABULARY* 



School 

A.B. Hart 

A. Hamilton . 

Audubon 

C. Shuler 

Centrml 

C. Eliot 
rC. Mooney 

C. Hestropp 

Empire 
v F.D. Roosevelt 
9 E.E. Davis 

J. Gallagher 

Lincoln 

M. Spellacy 

M.L. King 

M. T. Herricx 

N. Hale- 

N. Baker 

P. Henry 

R* Jamison • 
. 1". Jefferson 

V« Young I 

W. Wright 

Villson 



X Pre NCE 
N(p) (Fall Normsf 



/ 



13 
15 
12 
11 
16 



29.23 
35.26 
25.41 
31.54 
25.43 



12 40.41 

8 31.00 

15 2?. 00 

9 29.88 

13 ' 24.61 
9 31.11 

11 31.63 
9 . . 27.33 

13 30.69 

8 27.37 

7 • 28. S7 

6 39.00 

16 - 40.06 

15 30.40 

8 32.75 

7 31.00 

16 32.00 



X Post NCE 
(Spring Norms) 

21.69 
32.73 
33.91 
35.27 
25.87 
37.33 
26.87 
31.00 
31.88 
29.92 
33.66 
38.09 
29.77 
32.61 
32.50 - 
/, 26.85 
39.00 % 
36.18 
33.13 
--^ 

24.37 

32,85 
37.18 



Actual X Objective 
NCE Cain Attained 

m 

- 7.54 

- 2.53 

♦ 8.50 

♦ 3,73 

♦ .44 

- 3.08 

- 4.13 

♦ 2.00 

♦ 2.00 

♦ 5.31 

♦ 2.55 • 

♦ 6.46 

♦ 2.44 

♦ 1.92 

♦ 5.13 

- 1.72 

- 3.88 

♦ 2.73 

- 8.38 ^ 

.♦ 1.85 

♦ 5.18 



GRAND TOTAL 



249(b) 31.08 



32.04 



.96 



*The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to seventh 
trade participants during the weeks of 'October 20, 1980 and June 1, 1981. 

#An NCE Standard Score Gain which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or aore) is considered to bo educationally significant. tj ^ 

♦♦Objective criterion - at least a 4.00 mean gain. 

•School not served by Block/Skills Reinforcement Class. 

(b)Due to computer programming problems, the analysis was conducted on an approximate 
35% random sample of those 70S students for whoa both pre and post auditory vocabulary 
subtest scores were available. 



<■ . APPENDIX B-6 

1980-81 Stanford Diagnostic Reading Test Result^ 
, for Grade 7 Learning Center Classes 

AUDITORY VOCABULARY* 



/ 



School 

) 

A.B. Hart 




r X Pre NCE 
(Fall Norms) 


X Post NCE 
(SprinR'Nonns) 


Actual X 
NCE Gain 


Objective 
Attained 


20 


28.10 

V 


34.75 


♦ 6.65 


** 


A. Hamilton 


4 


39.00 


30.00 


- 9.00 




Audubon 


15 ' 


31.53 


29.06 


- 2.47 


*• 


C. Shuler 

Central 

.C. Bli^ \ 


11 
17 


ft. 09 
28^76^ 


46. 18 
34.76 


. i # 9i 
♦ 6.00 


3 


43.33 


33,00 * ( 


-10.33 




C. Mooney 


10 


29.00 


32.30 


♦ 3.30 




C, ttestropp 


4 


30.25 


' 28.25 


- 2.00 


• 


<£mpire 


12 


36. Zi 


30.41 


- 5,92 




F.D. Roosevelt 


4 


36.75 


39.50 . , 


♦ 2.75 




H.E. Davis 


2 


37,00 


32.00 






J. Gallagher if 


mm 


mmm 


... 






Lincoln 


11 


40.72 


46.09 


♦<5.37 


> 

** 


M. Spellacy 

V 


23 


31.56 


37.30 


♦ 5.74 




M.L. King 


8 


% 37.37 


33.75 


- 3.62 




M. T. Herrick 


3 


36.00 


31.00 


- 5.00 




N. Hale 


11 


34.45 


35.00 * 


♦ .55 




M. Baker • 












F. Henry 


4 


32.25 


f 

/ 34.75 


♦ 2..50 " 




JL Jamison y 


9 


34.88 


28.66 


- 6.22 




T. Jefferson 


8 


34.62 '/ 
^S.OO 1 / 


£ 36.50 


♦ 1.88. 




W. Young > 


3 . 


67.33 


♦12.33 




W.\jright 


15 


37.33 


33.86 


- 3.47 




Vinson 


2 


38.50 


34.50 ■ 


- 4.00 




craSd TOTAL 


199(b) 


34.61 


35.41 


♦ .80 





nhe Stanford Diagnostic Reading Test, Brown Level, Pora A. was administered to seventh 
Ijade participants during the weeks of October 20, 1980 and June 1, 1981. S 

# i!L NCE> L tandard Scort < * Ain wnich is 'ont-third of a Standard Deviation (i.e., 7.00 
MCE gain or more) is considered to be educationally significant* 

"Objective cri^rion - atleast a 4.00 aean gain. 

•Did not. serve grade 7 students. * 

••Auditory Vocabulary scores unavailable for students. 

(b)Due to computer programming problems, the analysis was conduction an approximate 50% 

random sample of the 394 grade 7 students for whom both pre and post auditory vocab- 
; ulary subtest scores were available. 
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APPENDIX B-7 



1980*81 Stanford Diagnostic Reading Test Results 
for Graded Learning Center Classes 

AUDITORY VOCABULARY* 



School 


aw- 


X Pre NCE 
(Fall Norms) 


X Post NCE 
(Spring Norms) 


Actual X 
NCE Gain 


A.B. Hart 


" 2 


36.50 


47.00 


♦10.50 


A. Hamilton 


8 


40. 7^ 


* 40.7* 


mmm 


Audubon 


. 19 


31.36 


35.57 


♦ 4.21 


C. Shuler 


3 


36.66 


33.00 


- 3.66 


Central 


11 


35.90 


32.63 




C. Eliot 


11 


43.81 


41.18 


- 2.63 


C. Mooney 


4 


25.50 - 


20.50 ' 


- 5.00 


C. Hestropp 


4 " 


34.25 


31.50 


- 4 


Empire 


10 


33. 8!) 


28.40 


- 5.40 


F.D. Roosevelt 


13 


38.53 


38.46 


- .07 


H.B. Davis % 


10 


44.10 


41. 90^ 


- 2.20 


J* Gallagher 


14 


38.42 


"34.14 


- 4.28 


Lincoln 


14 


36.00 


34.64 


- 1.36 


M. Spellacy 


3 


32.66 


30. ob 


* 2.66 


M.L. King 


.10 


34.10 


27.50 


- 6.60 


M. T. Herrick 


10 


32.31 

f 

30.66 


* 27.70 


• 4 40 


N. Halo 


15 


32.33 


♦ 1.67 


K. Baker 


* 11 


32.54 


35.81 


. 3.27 


P. Henry 
ft* Jamison 


1* 
22 


33.33 
38.45 


29.83 
33.68 


- 3. SO 
* 4.77 


T. Jefferson 


15 


33.00 


29.93 ■ 


' - 3.07 


W. Young 


6 


. 51.33 


54.83 


♦ 3.50 


W. Wright 


8 


48.62 


38.25 


rl0.37 


Jfillson 


8 


37.00 


34.00 


~ 3.00 



Obj ectivc 
Attained 



GRAND TOTAL 



736.44 



34.39 



• 2.05 



•The Stanford Diagnostic Reading Test, Brown Level. For* A. was*mdministered to eighth 
grade participants during the weeks of October 27. 1980 and June 1, 1981. 
* ' t * 

fttecause Spring Norms are not available at the eighth grade level, ninth grade Fall 

Norms were used to interpret the eighth grade post scores. 



##An NCE Standard Score Gain which is' one-third of a Standard Deviation .(i<«* , 7.00 
NCE gain or more) is considered *to be educationally significant. ~ 

♦♦Objective criterion - at least a 4.00 mean'gaih. 

(a)Due to computer programming problems, the analysis was conducted on an approximate 
37% random sample of the '661 grade 8 students for whom both pre and post auditor) 4 
vocabulary subtest scores were available. 
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APPEN01X B-8 

1980-81 Stanford Diagnostic Reading Test Results 
for Grade 9 Learning Center Classes 

AUOITORY VOCABULARY* 



X Pre NCE 



X Tost NCE 



V 

Actual X 



School 


N 


(Fall Norms) 


(Spring Norms') 


NCE Gain 


A.B. Hart 


1 


56.00 


62.00 


410.00 


A. Hamilton (b) 


— 


• — -» 


— 




Audubon • 0>) 


— 




— 


. — 


C. Shu lex 


2 


28.50 


28.00 


- .50 


Central 


7 


31.42 


31.00 


- .42 


C. Eliot 


S 


32.40 

4 


34. 80^ 


* 2.40 


C. Mooney 


, 3 


31.33 


39.66 


♦ 8.33 


C. Kestxopp 


n 


26.11 


33.29 


7.18 


Empire • 


— 


... 







P.O. Roosevelt 


7 


30.57 


38.28 


♦ 7.71 


11. E. Davis 


2 


41. SO 


47.50 


♦ 6.00 


J* Gallagher • 


— 


— 








Lincoln 


IS 


35.80 


42.53 


♦ 6.73 


M. Spellacyft) 


— 


— 


— 


— - 


M.L. Xing 


1 . 


40.00 


42.00 


♦ 2.00 


n« i • nfmcA v tf / 










M. Hale 


8 


28.25 


30.75 


4 2.50 


N. Baker 


5 


34.66 


34.33 


-y.33 


P. Henry 


7 


30.28 


.39.71' 


♦ 9.43 


R. Jamison 


33 


35.33 


38.42 


♦ 3.0$ 


T. Jefferson 


1 


36.00 


45.00 


4 9.00 


W. Young 0>) 










V. .fright 


2 


37.00 


29.50 


• 7.50 


Villson 


4 


35.00 


39.50 


♦ 4.50 


GRAND TOTAL 


118 


32.75 


37.23 


* 4.48 



Obj cctive 
Attained 



•The Stanford Diagnostic Reading Test, Brown Level, ^orm A, was administered to ninth 
grade participants during the weeks of November 3, 1980 and June 1, 1981. 

'Because Spring Norms are not available at the ninth grade level, ninth grade Pall 
Norms were used to interpret the ninth grade post scores. 

##An NCE Standard Score Gain which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or more) is considered to be educationally significant. 

"Objective criterion - at least a 4.00 mean gain. 

IDid not serve grade 9 students. 

(b)Missing pretest or posttest data. 
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APPENDIX C 



Title I Project STAR Stanford Diagnostic Reading Test , 
Reading Comprehension Subtest - Results for 1980-81 



N 



.131 



♦APPENDIX C-l 



1980^81 Stanford Diagnostic Reading Tost Results- 
For Grade 5 Nonpublic Classes 



READING COMPREHENSiqfl* 



School 

Immaculate 
Conception^ 

Our Lady of Good 
Counsel 

Sacred Heart of * 
Jesus 

St. Adalbert 

St. Benedicts 

St. Boniface* 

St. Catherine* 

St. Francis 

St. Ignatius* 

St. Jerome* 

John Neponucene 

St. Joseph/' 
' Franciscan* 

St. Leo* 

St. Phillip and 

St. Phillip Neri 
• §t. Stephen 
St. Vitus* 
Urban Comaunity* 



8 

K) 
6 



X. Pre NCE 
(Fall Norms) 



30.88 

28.33 
41.00 



13,00 



31.33 



31.37 
30.40 
13.33 



X Post NC^ # 
(Spring Norms, * 



38.77 

44.6(5 
60.00 



/ 21.60 



.37.00 



41.50 
36.00 
29.83 



Actual X 
NCE Gain* 



♦ 7.89 

♦16.33 
♦19.00 



.♦ 8.60 



♦ 5.67 



-♦10.13 
♦ 6.40 
♦16.50 



Objective 
Attained 



** 



GRAND TOTALS 48, ' 26.92 36.33' . ♦ 9.41, 

•The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to 
fifth grade participants during the Weeks of September 8, 1980 and May 11, 1981. 

•An NCE Standard Score Gain which is one-third of a Standard Deviation (i.e. ,7.00 
NCE gain or aoro) is considered to be educationally significant. 

♦•Objective criterion - at least a 4.00 mean gain 

•Did not serve Grade 5 students. 



ERIC 
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APPENDIX C-2 



1980-81 Stanford Dia'gnostifc Reading Test Results 
For Grade 6 Nonpublic Classes 



READING COMPREHENSION* 



School 

Immaculat% 

Conception 

Our Lad/ of Good 
Counsel' 

Sacred Heart of 
Jesus 

St. Adalbert 

St. Benedict 

St. Boniface 

St. Catherine 

St. Francis 

St. Ignatius! 

St. Jerome 

St* John Nepomucene 

St. Joseph 
Franciscan 0 

St* Leo 

St. Phillip and 
Janes 

St. Phillip Neri 

St. Stephen • 

St. Vitus 

Urban Community f 



tfs 

8 

3 
12 
•8 

4 

_ 

7 

14 

7 
4 



6 



X Pre NCE 
(Fall Norms) 

28.50— 

39.22 

39.00 
35.12 
53.33; 
36.08 
J7.50 
* 28.25 

i" 32.14 
37. i6 



33.35 



34.14 

< 

40.50 



24.83. 



X Post NCE 
(Spring Norms) 

40.50 

48.33 

49.50 
41.75 
/ 63.00 
51.83 
33.62 
3?.25 

36.71 
52.33 



54.78 

49.42 
49.00 

30.00 



Actual X 
NCE Gain* 



♦12.00 

♦ 9.11 

♦10.50 

♦ 6.63 

♦ 9.67 
♦15.75 

♦ 6.12 
♦11.00 

♦ 4.57 
♦15.17 

♦21.43 

♦15*28 

♦ 8.50 

m 

♦ 5.17 



Objective 
Attained 



GRAND TOTAL 



100 > 



34.40 



44.61 



♦10.21 



*The Stanford diagnostic Reading Test, Brown Level, Porn A, was administered to * 
sixth grade participants during the Weeks of September 8, 1980 and May 11, . 1981. 

'lAn NCE Standard Score Gain which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or more) i^onsidered to be educationally significant. 

••Objective criterion • at least a 4.00 mean gain 
- ibid not serve Grade 6 students. 
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APPENDIX C-3 



1980-81 Stanford Diagnostic Reading Test Results 
For Grade 7 Nonpublic Cj asses 



READING COMPREHENSION* 



School 



X Pre NCE X Post NCE 

\Jl (Fall Norms) CSprlng Norms) 



Immaculate 

Conception 6 32.66 

Our Lad/ of Good 

Counsel 3 40.33 

Sacred Heart of 

Jesus 3 23.00 

St. Adalbert 9 40.88 

St. Benedict 6 44.83 

St. Boniface 7 34.14 

St. Catherine -9 37.33 

St. Francis 4 s 22,00 

St. Ignatius u 43.09 

St. Jerome 8 41.00 

St. John Nepomucene 7 34.42 

St* Joseph 

Franciscan 0>) 11 27 . 54 

St. Leo 4 48.25 

St. Phillip and 

James 3 39.00 

St* Phillip Neri 4 29.75 

St. Stephen 11 39.00 

St. Vitus, 3 36.00 

Urban Community 4 43.25 



. v 34*50 

45.00 

19.66 
43.22 
52.00 
27.85 
41.11 
32.75 
"44.00 
47.37 
30.14 

35.90 
59.00 



Actual X Objective 
NCE Gain* Attained 



♦ 1.84 

♦ 4.67 

- 3.34 

♦ 2.34 

♦ 7.17 

- 6.29 

♦ 3.78 
♦10.75 

♦ .91 

♦ 6.37 

- 4.28 



♦ 8.36 
♦10.75 



♦,3.-00 




** 



GRAND TOTAL 



113 



36.91 



40.13 



♦ 3.22 



*The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to 
seventh grade participants, during the Weeks of September 8,1980 and May 11, 1981. 

'An MCE Standard Score Gain which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or more) is considered to be educationally significant. 

♦•Objective criterion - at le#st a 4.00 »can gain 

(b)Did not receive th* services of a project teacher. Instruction was provided by a 
full-time educational aide. v 
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APPENDIX C-4 



,1980-81 St anford Diagnostic Reading Test Results 
For Crade 3 Nonpublic Classes' 



READING COMPREHENSION* 



School 


N 


Immaculate 




Conception 


8 


far Lady of Good 


r ~ 


( Counsel 


16 


Sacred Heart of 




Jesus 




St, Adalbert! 


- 


St. Benedict 


12 


St, Boniface 


2 


St. Catfcjgine 


10 


St. Francis 


3 


St. Ignatius 


23 


St. JeroM 




St. John Nepomucent 




St. Joseph * 




Franciscan (b) 


15 


St. Leo 


13 


St* Phillip and 




James 


8 


St. Phillip Neri 


3 


St. Stephen! 




St. Vitus 


S 


Urban Co— unity 


4 


GRAND TOTAL 


1S6 



T Pre NCE X Post NCE 

(Fall Norms) ^ (Fall Nonas )# 



29.87 
45.63 

25.00. 



v 



40.33 
32.00 
37.80 
^28.33 
38.61 
36.15 
41.29 

11.47 
4$. 38 

45.38 
28.67 

17.40 
37. SO 



27.63 
51.31 
26.14 

42.75 
32.50 
39.90 
29.33 

40.. 00 
35.71 

36.40 
43.77 

42.63 
35.33 

m 

25.40 
42.50 



Actual X Objective 
NCE Cain* # Attained 



- 2.24 

♦ 5.68 

♦ 1.14 

♦ 2.42 

♦ .50 

♦ 2.10 

♦ 1.00 

♦ 3.82 

♦ 5.85 

- 5.58 

♦24.93 

- .61 

- $.75 

♦ 6.66 

♦ 8.00 

♦ $.00 



35.61 



40.01 



♦ 4.40 



Diagnostic Reading Test, Broun Level, Form A, was administered to 
eighth grade participants during the Weeks of September 8, 1980 tnd May 11,1981. 
'Because Spring Norms are not available at the eighth grade level /ninth grade Fall 
Norms were usee 4 to interpret the eighth grade post scores. 

* 9 *"™ ******* f»» 6»in which is one-third of a Standard Deviation (i.e., 7.00 
MCE gain or more) is considered to be educationally significant. 

♦♦Objective criterion - at least a 4.00 mean gain 
!Did not serve Grade 8 students. * 
(b)Did not receive tho, sorvices of a project teacher. Instruction was provided by a 
full-time educational aide. 
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XJPPLNTUX C-S 



1980-81 Stanford Diagnostic Reading Test Results 
For Grade ? Clock/Skills Reinforcement Classes 



•READING COMPRLHENSION* 



School 


K 


T Pre NCE 
(Pall Norms) 


* X Post NCE 

(Spring Norms) 


Actual X 
NCE Gain* 


A.B. Hart 


38 


26.07 


19.68 


-6.39 


A. Hamilton 


40 


27.90 


30.45 


♦2.55 


Audubon 


36 


29.44 


52.52 


♦3.08 


C. Shuler 


31 


28.87 


50.00 


* el. IS 


Central 


46 


25.76 


25.83 


♦ .07 


C. Eliot 


36 


31.37 


28.75 


-3.22 


C. Mooney 


22 


^ 29.81 


25.63 


-6.18 


C. Hestropp 
Empire 


40 


, 29.12 


2S.0S 


-4.07 


27' 


25.25 


24.81 


- .44 


F.D. • Roosevelt 


38 


29.44 


28.28 


-1.16 


H.B. Davis 


27 


24.59 

! ' 


2S.SS 


♦ .96 


J. Gallagher 


50 


23.45. 


24.80 


♦1.37 


Lincoln 

M. SpeHacy 


28 

37 


22.57 
23,56 


V 24.28 
24.57 


♦1.71 
♦ .81 


M.L. King 


26 


2S.46 


28.75 


♦5.27 


M. T. Herrick 


20 


27.45 


26.80 


- .65 


N. Halt 


18 


20.00 


15.88 


•4.12 


N. Baker 


41 


- 50.26 


27.26 


•5.00 


P. Henry 


40 


50.97 


52.17 


♦1.20 


K. Jamison I 






m 


m 


T. Jefferson 


22 


S 23.59 


22.86 


- .75 


V. Youngt 
V. Wright 


21 


28.14 


29.58 


* el. 24 


Willson 


41 


29.97 


. 30.75 


- .78 


GRAND TOTAL 


705 


27.55 


26.84 


-.51 



Ob j cct ive 
Attained 



•The Stanford Diagnostic Reading Test. Brown Level, For* A, was admin is tored to 
seventh grade participants during the Weeks of October 27, 1980 and June 1, 1981. 

#An NCE Standard Score Cain which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or more) is considered to be educationally significant. 

••Objective criterion -\*t least a 4.00 mean gain \ 
•School not served by Block/Skills Reinforcement Class. 
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APPENDIX C-6 



1980-31 Stanford Diagnostic Reading Test Results 
z 1 For Grade 7 beaming Center Classes 



READING COMPREHENSION* 



School 


' H 


. 7 Pre NCE 
(Fall Norms) 


X Post NCE 
(Spring Norms) 


Actual' X 
•NCE Gain! 


A.B. Hart 


3? 


30.92 


29.25 


-1.67 


A, Hamilton 


7 


34.14 


38.42 


♦4.28 


Audubon 


30 c 


28.86 


27.40 


-1.46 


C. Shu lex 


21 


47. S2 
* 


47.28 


- .24 


Central 


35 


25.02 


30.62 


♦3.60 


C. £liot 


5 


32.40 


34.20 


♦1.80 


C. Mooney 


20 


26.45 


28.25 


♦1.80 


C. Westropp 


8 


28.50 


21.87 


-6.63 


Empire 


23 


29.69 


34.00 


♦4.31 - 


P.O. Roosevelt 


s 


- 37.62 


38.62 


♦1.00 


H.B. Davis 


5 


33.60 


37.20 


♦3.60 


J, Gallagher , 


.2 


25.50 


* 29.00 


♦3.50 


Lincoln 


21 


53.90 


41.00 


>7.10 


M. Speliacy 


46 


30.54 


32.47 


♦1.93/ 


M.L. Xing 


28 


27.14 


29.92 


♦2.78 


M. T. Herrick 


' 6 


25.83 ; 


• 26.66 


♦ .83 


W. Hale 


22 


33.00 


32.77 


- .*23 


N. Baker! 










P. Henry 


8 


28.62 


30.62 


♦2.00 . 


R. Jamison 


18 


27.66 • 


30.16 . 


* +2.50 


T. Jefferson 


' IS 


38.53 


42.93 


♦4.40 


W. Young 


3 


64.00 


65.33 


♦1.33 


W. Wright 


30 


34.80 


' 37.13 


♦2.33 


Villson 


4 


35.50 


31.00 


-4.50 


{jjtAND* TOTAL 


4*04 


31.72 


ZS.S1 


♦1.65 * 



Objective 



♦The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to 
seventh gride participants during the Weeks of October 27, 1980 and June 1, 1981. 



'An NCE Standard Score Gain^which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or more) is considered to be educationally significant. 

''Objective criterion - at least a 4jQfi^an gain 1 
•Did 'not serve Grade 7 students. 
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APPRNIUX C-7 



1980-81 Stanford Diagnostic Reading 
Test Results for Grade a learning Center Classes 



READING COMPREHENSION* 



School 




a Pre NCE 


X Post NCE 


Actual 


N 


(Fall Norms) 


(Fall Norms)* 


NCE Gai 


A.B. Hart 


3 


*3B.35 


30.00 


-8. ^33 


A* Hamilton 


19 


34.00 


31.73 


V -2.27 


Audubon 


S3 


31.90 


29.83 


-2.07 


C. f Shuler 


8 


32.25 


32.75 


♦ .50 


Central 


29 


30.82 


29.44 


-1.38 


C. Eliot 


31 


'37,22 


33.77 . 


-3.45 


C. Mooney 


10 


31.90 


28.90 


-3.00 


C. Westropp 


7 


28.71 


24.42 


-4.29 


Empire 


22 


33,54 


28.50 


-5.04 


P.D. Roosevelt 


36 


35,37 


31.54 


-3.83 


H.B. Davis 


27 


31,33 


^ 30.14 


-1.19 


J. Gallagher 


39 


29.82 


31.05 


♦1.23 


Lincoln 


41 


.32,19 


30.00 


-2.19 


M. Spellacy 


3 


22,33 


• *24.33~ 


♦2.00 


M.L. King 


29 


. 32.B6 ^ 


31.17 


-1.69 


M. t. Herrick 


28 


31,53 


26.00 


-5.53 


N. Hale 


44 


32,65 


31.02 


-1.63 


H. Baker 


34 


29,17 


30.23 


♦1.06 


P. Henry 


35 


36.62 


34.60 


-2.02 


iU Jamison 


60 


36.21 


31.03 m 


-5.18 


T. Jefferson 


43 


32.81 


32.86 


II 

♦ ,os K 


V* Young 


IS 


48.06 


49.60 


♦1,54 


J. Wright 


22 


30.81 


33.36 1 


♦2,55 


Villson o 


23 


24.91 


9 34.95 


\ ♦ -04 



Objective 
Attained 



GRAND TOTAL 661 



33,33 



31. J9 



-1.94 



•The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to 
eighth grade participants during the Weeks of October 27/ 1980 and June 1, 1981, 

f Because Spring Norms are not available at the eighth grado level, ninth grade Fall 
Norms were used to interpret the eighth grade <post scores, 

§9 tL mB Standard Sc°r« Gain which is one-third of a Standard Deviation (i.e., 7 00 
NCE gain or more) is considered to be educationally significant. 

♦♦Objective criterion - at least a 4.00 mean .gain w 
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APPENDIX C-8 



1980-31 Stanford Diagnostic Reading Test Results 
For Grade 9 Learning Center Classes 



READING COMPREHENSION* 



7 Pre NCE 



X Post NCE 



Actual X 



Objective 



ERLC 




School 


N 


(Fall Norms) 


(Fall Norms)* 


NCE Gain* * 


Attained**^ 


A.B. Hart 


1 


15.00 


Jo^OO 


♦11.00 




A. Hamilton (b) 






- 


- 




Audubon (b) 


— 




A/ 


- 




C. Shuler 


2 


26.50 


32.50 


* ♦ 6.00 




Central 


7 


29.57 


32.85 


♦ 3.28 




C. Eliot^ 


6 


28.66 


33.66 


♦ 5.00 


** 


C. Hooney 


4 


31.50 


25.50 


- 6.00 


• 


0* Westropp 


16 


26.25 


29.37 


♦ 3.12 




Empire! 


— 


- 


v 






P.O. Roosevelt 


7 - 


35.00 


37.14 


♦ 2.14 




H.E. Davis 


2 . 


42.50 


46.00 


♦ 4.50 




J. Gallagher! 


— 


• 




- 




Lincoln 


IS 


30.00 


32.66 


♦ 2.66 




M. Spellacy (b) 












M.L. King 


1 


10,00 


10.00 






U T tU i- 9 1 j t fhV"' 
w# j • nOTXic*> \Vj 




» 








M. Rale 


8 


31.25 


32.6.2 


♦ 1.37 




K. Baker 


3 


25.66 


17.00 


- 8.66 




F. Henry 


7 


29.71 


35.28 


♦•5.57 


** 


R. Jamison 


33 


33.75 


^ 33.48 


- .27 




T. Jefferson . 


1 


30.00 


26.00 ^ 


- 4.00 




W. young (b) 












W. Wright 


2 


33.50 


' 32.00 


- 1.50 




Villson 


4 


30.79-- 


32.47 


♦ 6.75 


•* 


GRAND TOTAL 


119 


30.79 


32.47 * 


• * ' 





♦The Stanford Diagnostic Reading Test, Brown Level, Form A, was administered to 
ninth grade participants during the Weeks of October 2?, 1980 and June 1, 1981. 

# Because Spring Norms are not available at the ninth grade fevel, ninth grade Fall 
Norms were used to interpret the ninth grade post scores.* 

IIAn NCE Standard Score Gain which is one-third of a Standard Deviation (i.e., 7.00 
NCE gain or more) is considered to be educationally significant. 

••Objective criterion - «t least a 4.00 mean gain ' 

•Did not serve Grade 9 students. , 
(b)Missing pretest or posttest data. < 
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APPENDIX B 



Title Project STAR Everyday Skills 
Test Reading and Study Skills SubtestTesults 
For 1980-81 \ 



ERIC 
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APPENDIX 0-1 



1980-81 Everyday Skills Test Results 
Block/Skills Reinforcement CI 



for Grade 7 



Classes 



READING* 



School 


N 


X Pro Raw 
Score Gain 


X Post Raw 
Score Gain 


Actual 
Raw Score 


X 

Gain 


Objective 
Attained 


A.B.. Hart 


34 


24.82 


28.44 


♦ 3.62 




** 


A. Hamilton 


38 


24.92 


28.45 


«. - 

♦ 3.53 




** 


« Audubon 


31 


' 25.74 


29.23 


♦ 3.49 




** 


C. Shuler 


40 


26.23 


31.08 


♦ 4.85 




** 


Central 


39 > 


24.77 


25.64 


♦ .87 






C. Eliot 


31 


?7.16 


30.10 


♦ 2.94 




1 


C. Mooney 


23 


28.52 


28.52 








C. Ifestropp , 


2* 


26.88 


30.46 


♦ 3.58 






Enpire 


27 


20.41 


25.89 


♦ 5.48 




*# 


P.D. Roosevelt 


41 


27.S4 ' 


29.63 


♦ 2.09 






H.E. .Devis^ 


29 


28.28 


29.83 


♦ l.SS 






J. Gallagher 


26 


28^77 


31.04 


♦ 2 27 






Lincoln 


30. 


23.97 


26.40 


♦ 2.43 






HWSpellacy 


30 


22.26 


24.29 


♦ 2 






M.L. King 


31 


23.29 


29.65 5 


♦ 6.36 




•* 


M. T. Herrick 


24 


27.88 - 


29.38 


♦ 1.50 




- 


N. Hale 


24 


31 21 


27.00 


♦ 5.79 




*• 


K. Baker 


SO 


28.62 


31.16 


♦ 2.54 




** 


P.* Henry 


38^ 


27.50 


29.61 


♦ 2.11 






JL Jamison e 














T. Jefferson 


35 


25.60 


26.83 


♦ 1.23 






W. Young 














W. Wright 


, 26 


20.27 


31.27 

* 


♦11*00 




> > 
** 


Willson 


35 


25.83 


33.74 


♦ 7.91 




*# 



Grade 7 public 
School Total 



708 



25*48 



28.98 



♦ 3.50 



34.82 



3S.96 



Cleveland Centra/,. 
Catholic Total ? * 
(Grades 9, 10 and 
12 represented) 

* The Everyday Skills <Test*Rcading Test A was, administered, to STAR participa 
during the Weeks of November 10, 1980 and 'May 25 J 1981. The roading test 
contain* a total of 4S items. v " * * x 

t School not sorved by Block/Skills fceinforccmont' Class. 

# * Tho actual mean. raw scoro gain was demonstrated to be statistically significant 
(P S .OS). Ail tests arc two-tailed. ^ 
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APPENDIX D-2 



/ 



1980-81 Everyday Skillg Test Results for Grade 7 
Block / Skill s Reinfo rce ment Classes 

, STUDY SKILLS* 



erJc 



School 


N 


TPre HO? • 
(Tall Nornsl 


X Post NCB 


Actual X 
NC.E GaiA* 


Obj octivo 
Attained 


A. B. Hart 


«>** 


20. 26 


19.23 - 


< 

- 1.03 




A. Hamilton 


Yd 

J| 


19.73 


22.63 


♦ 2.90 




Aiiduhnn 
nuwuuuii 


31 


23.81- 


• B 26.21 


♦ 2.40 




C. Shuler 

we Vlnl4V4 

Central 


r 


20.82 
18.97 


25.11 • 
17.48 


- 1.49 


## 


C. Eliot 




13.70 


27.35 


♦>8.65 




C. Mo*ey 




10. 44 


* 23.94 


♦ 7.50 




C. tfestropp 


27 


7T on 


26.24 


♦ 3.24 




Empire 


27 




17.00 


♦ .19 




P.D. Roosevelt 


41 


*o. 90 


26f75 


- 1.83 




H.E.^Davis 


29, 


7A CiA 

«o« oo 


23.93 

» 


- 2.13 




J. Gal lather" 




24*23 


27.46 


♦ 3.78 




Lincoln 


ic 


23.68 


23.04 


- .64 




n. opei lacy 


31 


12.03 


13.92 


♦ 1.89 c 




ML Wvl9 


90 

r 23J 


22,55 


23.10 


♦ .55 




ft* J . rWTTiCA 


20 


21.95 


] 25.65 s 


♦ 3.70 






24 


21.83 


20.27 


- 1.56 




M. Baker 


50 


22.19 / 

/ 


24^3 z 


♦ 2.04 




"P. Henry 


33 


24.31 


26.44 


♦ 2.13 




1U Jamison t 












T. Jefferson 


33, 


22.54 


19.72 


- 2.82 




V.' Young • 












V. Wright 


21 


25. 9S 


28.04 


♦'2.09 




Wilson* 


35 


22.25 


26.34 


♦ 4.09 




Grade 7 Public 
School Total 


66$ 


21.80 


< 

22.81 

— 4tr — 


♦ 1.01 





Cleveland Central — — — . 

Catholic Total 9* $r 

O tesults «r« aot iaclad«4 la taa tbve aaalys'is eae * • tae aacv&ilibility of spprepriata 
free* level mim. Th« statfy skill Mctloa •£ tfe« EST Km bM t4ept»4 free tfc* CTtt 
rem *, Uvtl 3 for naieh teas* *-* aeraa art oely evallaals. t 

• !>• ftrtryeay fltillt T«ft Stuty Skills nAti^Mi sdslaisttrW tt Uedt stoicats 
evrlat the Ntsks of fevmtwr 17, 1910 «U Jt»» 1, 1911. Tk# stwiy tUll tsat 
ceatalae a teul of SO iteas. 

• Seaoel aet sscvW *y Sleek/Skills iala J erew m CUii. 

• * \» 

t A HC8 Sue**** Start Caia *e*dk is tae*tal*4 •£ a Suaaeri Deviatioa (!.«., a 7.00 
JO^sis «r am) U eeesieerse U W eaaaatiaaaUy sigaifiaaat. 



Oajeetlva erittriea • at Uut a 4.00 ICS : 



mr gain. 
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APPENDIX E 



Title I Project STAR Comprehensive Test of Basic 
Skills? Mathematics Computation Subtest Results 



for 1980-81 



143 



APPENDIX E-l 

J980-81 Comprehensive Test of Basic Skills 
Results for Grade, 5 Nonpublic 
Classes 

MATHEMATICS COMPUTATION* 



School ^ 

Immaculate 
Conception 

Our Lady of Good 
Counsel 

Sacred Heart of 
Jesus • 

St. Adalbert 

St. Benedict G 

St. Boniface 9 

St. Catherine I 

St., Francis 

St*. Ignatius. I 

St/ Jerome • 

St. John Nepomuce^ie 

St. Joseph 
Franciscan I 

St. Leo • 

St. Phillip and 
James 

St/ Phillip Neri • . 

St. Stephen • 

St. Vitus: I V 

Urban Community • 



N 

6 



-J 



X Pre NCE 
(Fall Norms) 



46.25 



37.60 



43.$0 



38.25 



X Post NCE 
(Spring Norms) 



39.00 



35.20 ) 



39.25 



V 



Actual X Objective 
NCE Gain! Attained 



7.25 



2.40 



4.25 
t 



50.50 



♦12.25 



GRAND TOTAL 



17 



41.17 



40.64 



.53 



•Did not conduct grade 5 mathematics skill instruction. 

,*The Comprehensive Test of Basic Skills, Form Q, Level 2 was administered to fifth 
grade participants during the weeks of October 13, 1980 and May 18, 1981. 

|An NCE- Stamford Score Gain which is one-third of a Standard Deviation, (i.e. , a 7.00 
t > NCE gain or more) is considered to be educationally significant. * 

♦•Objective criterion - at least a 4.00 NCE mean gain. — 



-149- 



144 



APPENDIX E-2 

1980-81 Comprehensive Test of flasic Skills 
Results for Grade 6 Nonpublic 
Classes 

MATHEMATI CS, COMPUTATION* 



School 
V 


N 


X Pre NCE 
CFall Norms) 


X Post NCE 
(Spring Norms) 


-Actual X 
NCE Gain! 


Obj ective 
Attained 


Immaculate 
Conception - 


'3 


30.00 


30.66 


▼ . DO 




Our Lady of Good 
Counsel 


6 


28.33 c 


jp.qo 


♦ 3.67 




Sar Ted Heart of 
Jesus 9 

' 0F Adalbert 


4 


49.75 


46.75 


— 

- 3.00 




St Benedict 


c 

d 




Ay An 


» o on 
+ o. «U 


** 




A V 
4 IS, 


. 45 


45. Uv^§£ 


♦ O. /5 




St. Catherine 8 












A, 

St. Francis 


4 


43.50 


32.50 


-11.00; 




St. Ignatius I 


— * 


r 




- : -T 




St. Jerome 1 


— ■* - 




— m 






St. John Nepowucene 


4 


37. 00 


49.75 


. +12.7$ 


** 


■> 

St. Joseph 
Franciscan 0 








— 


• 


St. Leo 


1 


34.00 


23. 0Q 


-11.00 




St. Phillip and 
James 


6 


45.00 


36.83 


- 8.17 




St. Phillip Neri • 












St. Stephen 


4 " 


44.00 


_*2.25 


- 1^75 

< * ... 




St.^Vitus ; 


7 


36.85 


• 32.28 


- 4^57 




Urban* Community | 






^— 






GRAND TOTAL 


48 


39.68 


38.50 


- 1.18 





* IDid'^tbt conduct grade 6 Mathematics skill instruction. 
•The Comrehensive Test of Basic Skills,' Form Q, Level 2 was adninistered to sixth 
grade participants during the weeks of October IS, 1980 and May 18, 1981. 

IAn NCE Standard Score Gain which is one-third of a Standard Deviation (i^e. , a 7.00 
MCE gain or aore) is considered to be educationally- significant. 

•♦Objective criterion - at least a 4.00 NCE aeon gain. 
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APPENDIX C-3 

1980-81 Comprehensive Test of Basic Skills 
Results for Grade 7 Nonpublic 
Classes 







MATHEMATICS 


COMPUTATION* 




- 


School 


n 


T Pre NCE 
rpall Norms') 


X Post NCE 

f Sdt in p Norms ^ 


/ 1 

Actual T 
NCE Gain* 


Objective 
Attained 


\ 

x uuua wu x u i c 

Conception 


6 


40.50 


49.00 


/ + 9.50 


*• 


Our Lady of Good 

Pram < * 1 


4 


38.25 


50.50 


♦12.25 


** 


o*cxcu ne&rx or 
Jesus 


0 
0 


4,0 * ZD 




f 4-11,87 


** 


St. Adalbert 


8 


43.25 


53.50 


♦10.25 „ 


•« 


St. Benedict! 


6 


58.50 


68:. 66 


♦10.16 


**' 


St* Boniface 


6 


40.66 


43.33 


« i 2.67 




St. Catherine 1 












St. Francis - 


3 


53.66 


46,00 


- 7.60 


• 




12 


47.41 v 


46.66 

i 


- . .75 




St. Jerome 9 












St. John Nepoaucene 

> * 


6 


50.50 


3^50 . 


-16.00 




St. Joseph 

Franciscan *<l <w 

St. Loo 






— 

; — ^ 


— - 




St. Phillip and, 
Jims 

St.- Phillip Neri • 


3 


.51.66 


^.33 

,* \ : 
i * * ' 

y ; 1 


♦10.67 


** 


St. Stephen 


2 


48.00 


47,00 


\-4.00 




St. Vitujfe • 
Urban Community 


1 3 • 


30. is <" * 


* * 
3S.33 

• ( 


.+ 5*00 ' • 

. <v $ 


** ' 


GRAND TOTAL 


67 


\ 43.87 


47.95 \ 


^ ♦ 4,08 F 





•Did not conduct grade 7 mathematics skill instruction. i j 
•The Comprehensive Test of Basic Skills, Font T, Lev^i 3 was administered to seventh 
grade participants during the weeks of October 13, 1980 4nd May 18; 1§81. 

#An NCE Standard Score Gain which is one-third of a StaiuiVrd Deviation (£e.» « 7.00' 
NCTjain or »ore) is considered to be educationally significant. 

♦♦Objective criterion - at least' a 4.00 NCE aean gain. 
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APPENDIX E-4 

1980-81 Comprehensive Test of B^sic Skills 
Results for Grade 8 Nonpublic 
Classes 

/ 

MATHEMATICS COMPUTATION* 



7 



School ^ £ 

Immaculate 8 
- Conception 

Our Ladyvof Good 14 
Counserv 

Sacred Heart * of 6 
Jesus 

St. Adalbert 8 

St. Benedict 6 

St. Boniface 3 

St. Catherine f «*- 

St. Francis 2* 
V 

St. Ignatius ' 23 

1st. Jerome i \ 

St. John Nepowucene 2 

St. Joseph 
Franciscan I 



St. Leo 

St. Phillip and 
James 

St. Phillip Neri • 

St. Stephen • 

St. Vitus • 

Urban Community 



X Pre NCE 
(Fall Norms) ♦ 

40-25 



SO. 64 
36.33 



40.66 

37.50 * 
49.60 

64.00 

40.40 
61.66 



X Post NCE* 
(Spring Norms) 

49.50 
49.84 
35.33 



41.66 

38.50 
52.00 

56.00 

46.00 
59.66 



Actual X 
NCE Gaing 

♦ 9. 25 



) .80 

l.OOfc 



Objective 
Attained 



♦ 1.00 

*J 1.00 
♦'2.40 

♦ 8.00 

♦ 5.6<K 
- 2.00 

— \ 



25.57 



38.28 



•♦12.71 



GRAND TOTAL 



73 



44.94 



47; 16 



♦ 2.22 




•Did not conduct grade 8 mathematics skill instruction. 

♦The Comprehensive Test of Basic Skills, Porn T, Level 3 was administered to eighth 
grade participants during the weeks of October 13, 1980 and May 18, 1981. 

NCE Standard Score Gain which is one-third of a Standard Deviation (i.£. $ a 7.00 
NCE gain or more) is considered to be educationally significant. 

0bjecti)(e criterion - at least a 4.00 NCE mean gain. 
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APPENDIX F 

Title I Project STAR Attendance Percentage Rate' 
Comparisons for the 1980-81 School Year 




i - 
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APPENDIX F-l 

Comparison of School 'Attendance Percentage Rctes for the 1980-31 School Year 
BLOCR/SKIILS REINFORCEMENT CLASSES (GRADE 7) VS. TOTAL GRADE 7 



School 



Block/Skills Rcinf. Total Grade 7 Black/Ski.Us Reinf . (Grade 7) 
Students Grade 7 Students Minus Total Grade Students 



r 



> 



A. B. Hart 
V 


66 


77.04% 




71.21% 


♦5,83 


"A. Hamilton 

> 


58 


82-. 40% 




82.60% 


,20 


Audubon ^ 


65 


75.62% 




73.79% 


♦1.83 


C. Shuler 


48 


* ,85.40% 




t 

83.82% 


♦1.58 


Central 








N 




74 


79.82% 




75.51% 


♦4.31 


C. Eliot l 


48 


84.82% 




83.41% 


^ +1.41 


C. Mooney 


SO 


80.11% 




79.92% 


♦1.90 


C. Westropp 


63 


85.48%^ 




79.37% 


♦6.11 


Empire 


50 


78.61% 




71,42% 


♦7.19 


F. D. Roosevelt 








OO Ait 

5Z.04? 


♦3.81 


H. E. Davis 


55 


76.10% 




74.03% 


♦2.07 


J. Gallagher 


53 


68.50% 




78.05% 


+9,55 


Lincoln ~~ 


~* 62 


75.46% 




77.58% 


-2.1Z 


M. Spellacy 


* 


* 




* 


* 


M. L. King 


49 


65.97% 




66.07% 


- .10 


M. T. Herrick 


49 


70.35% 




67.70% 


♦2.65 


N. Hale 


54 


76.49% 




77.44% 


- .95 


N. Baker 


62 


82.76% 




82.07% 


♦ .69 


Henry 
R. Jamison 


y 


83. ?2% 




80.09% 


♦3.83 












T. Jefferson 


57 


78.47% 




77.58% 


♦ .58 


W. Young 
W. Wright , 












50 


81.36% 




80.02% 


♦1.34 


Willson 


55 


82.93% 




83.21% 


♦ .28 



4. 



Grand Total 



1161 
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79.33% 78.37% ♦ .96 

»#At tendance* rate. comparisons are presented for\n>blic schools only. Nonpublic school 
attendance comnaris6ns havo not been made, due to the unavailability of^systenuvide data. 

♦Attendance data unavailable 

•School not served by Block/Skills Reinforcement Class. #. 
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APPENtfIX F-2 

Comparison of School Attendance Percentage Rate5 for the 1980-31 School Year v 

^ LEARNING CENTER CLASSES (GRADE 7) VS. T0TAI; GRADE 7 STUDENTS* 

r 

Learning Center Students 



♦ 

School 


N 


Learning Center 
Students Grade 


Total Grade 
7 Students 


A. B. Hart 


61 


75.38 r 


71.21 


A. Hamilton 


15 


83.63 


82.60 


Audubon * 


47 


76.17 


73.79 


C. Shuler 
Central 


29 


88.68 


83.82 


S3 


74.48 


75.51 


C. Eliot 


16 


74.83 

85.08 * 


'83.41 


C* Mooney 


32 


79.92 


C. Westropp 


. 17 


81.28 


79.37 


Empire v 


39 


74.85 


71.42 


P. D. Roosevelt 


23 


77.26 


82.04 


H. E. Davis 


S 


• 70.47 . 


V 

74.03 


J. Gallagher 


8 


68.37 


78.05 


Lincoln ' 


31 


" 73.53 


77.58 


M. Spollacy 


61 


86.13 


86. 71 1 


M. L.,JCing 


47 


75.68 


66.07 


M. T. Herrick 


14 


72.26 *• 


67.70 


N. Hale 


<* > 


80.63 


77.44 


N. Baker 


3 


60.67 


82.07 


P. Henry 


19 


68.31 


t 80.09 


R. JaMison 


'28 


•* * 
89.01 . 


^ 87.93 


T. Jefferson 


21 


82.19 


* 77.58 


W. Ywing 


7 


73.00 


91.42 


W. Wright 


34 


83.21 


80.02 


Willson 


11 


84.66 


83.21 


Grand Total 


667 


79.17 


' • 78J&7 



♦ 4.17 
f ♦ 1.03 

♦ 2.38 

♦ 4.86 

- 1.03 

- 8.58 

♦ 5.16 

♦ 1.91 

♦ 3.43 

- 4.78 1 

- 3.S6 

- 9.68 
^ 4.05 

- \5* 

s - 

♦ 9.yi 

4.56 

♦ 3. Id 
-21.40 
-11.78 

♦ 1.08 ^ 

♦ 4.61 
-18.42 . 

♦ 3.19 

♦ 1.45 




.80 



#Attendance rate comparisons are presented for public schools only. Nonpublic school 
attendance comparisdns have not been aade due to tho unavailability of systemwide data. 
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APPENDIX F-3 

Comparison- of ^School 'A ttendance Percentage Rates for the 1980-81 School Year 
EARNING CENTER CLASSGS(GRADE S) VS. TOT A Ft GRADE 8 STUDENTS* - 



School X 

«> 

A. B. Hart 8 

A. ^Hamilton 38 

Audubon * 85 

C. Shuler * 21 

Central 48 

C. Eliot 40 

C. Mooney \\ 

C. tfestropjp 18 

Empire ' 23 

F ; D. Roosevelt 59 

H. B. Davis 39 

J. Gallagher * 60 

Lincoln 71 

M. Spellacy 10 

M. L, King |0 

M. T. Herriclt, 50 

M. Hale . 61 

N. Baker 43 

P. Henry 74 

R. Jaaison 73 

T. Jefferson 44 

W. Young 25 

W. Wright # 32 

Willson .40 



V 



Learning Center 
Students Grade 8 

\ 

51.65 % 
84.20 
76. 68 * 
. *5.66 
75.71 
85.07 
90.33 
73.11 
80.00 
,76.26 
. 75.96 
78.93 
73.14 
33.09 
68.96 
73.93 
83.87 
87.05 

s 

76.36 
90.06 
79.58 
87.72 
80.39 
79.40 



fStal Grade 8 Learning Center Students' 
Stu4ents ^Minus Total Grade 8 Students 



71. 4r 

82.62 
73.84 
82.00 
75.48 
81.89 
76,88 
76.26 
71. S4 
78.02 
71.69 
75.00 
73.61 
34.51 
62.54 
67.70 
75.09 
82.80 
t 77.97 £ 
87.72 
73.94 
88.42 
77.40 
78.56 



Grind Total 



-19.81 

♦ 1.58 

♦ 2.84 
\ ♦ 3.66 

♦ .23 

♦ 3.18 
*.3.4§ 

- 3.15 

♦ 8.46 

- 2.24 

♦ 4.27 

♦ 3.9£ 

- .47 

♦ 1.42 

♦ 6.42 

♦ 6.23 

♦ 8 t 78 

♦ 4.25 
1.-61 

♦ 2.34 
♦?S?64 

♦ .70 

♦ 2.99 

♦ .34 



1028 



79.03 



76.77 



♦ 2.26 



♦Attendance rate comparisons are presented for public "schools only. Nonpublic school 
attendance comparisons have-not tfecn aade duo to the unavailability of systenu-idc data. 
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APPENDIX f-4 

' Comparison of School Attendance Percentage Rates for the 1930-31 School Year 

s 

LEARNING CENTER CLASSES (GRADE 9) VS. TOTAL GRADE 9 STUDKNTS* 



School 


N 


Learning Center 
Students Grade 9 


Total Grade 9 
Students 


Learning Center Students 
Minus Total Grade 9 Students 


* 

A. B. Hart 


4 


58.16 


70.33 


- 12.17 


A. Hamilton 


4 


80.75 


78.74 


+ 2.01 


Audubon ' 


1 


45.00 


67.02 


- 22.02 


C. Shuler 


12 


70.70 


79,43 


- 8.73 


Central 


8 . 


83.89 


73.88 


+ 10.01 


£. Eliot 


9 


82.38 


79.52 


♦ 2.86 


C. Mooney 


5 


* 84.32 


• 71,78 


+ 12.54 


C. Westropp 


25 


85.51 


79.99 


+ 5.60 


Empire • 










P. D. Roosevelt 


18 


60.86 


76.11 


- 15.25 


-H. E. Davis 


11 


75.96 


66.13 


♦ 9.83 


J. Gallagher o 










Lincoln 


36 


76.62 


74.52 


♦ 2.10 


M. Spellacy 


ao 


85.77 


87.71 


- 1.94 


M. L. King 


12 


53.59 ' 


58.87 


- 5.28 


M. T. Herriclc 


1 


58.00 / 


64.10 


- 6.10 


N. Hale 


19 


72.28 u 


70.19 ; 


♦ 2.09 x 


N. Baker 


3 


84.50 


80.01 


* 4.49 


P. Henry 


21 


83.66 


75.39 


. ♦ 8.27 


R. Jamison , 


42 


89.12 


84.07 


♦ 5. OS 


T. Jefferson 


3 


*4 r so , 


72.07 


♦ 12.43 , 


W. Young 


1 


63.58 


86.94 


- 23.36 


W. Wright 


3 


86.67 


77.30 


- 9.37 


Wilson 


7 


S7.86 


80.37 


- 7.49 


Grand Total 


225 


76.78 


74.03 


♦ . 2.75 



f Attendance- rate comparisons are presented for public schools only. Nonpublic school 
attendance comparisons have not been aade due to tha unavailability of systemwidc data. 



•Did not serve Grade 9 students. 
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. . APPENDIX ?G ' - 

Title I Project STAR Achievemjfot. Test and Attendance Results for 
School Years 1976-77 through 1 $66-81 > ^ 
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APPENDIX G-l 







/ VOCABULARY 

( 


\ 




\ 

/ 






Year 


Gr. 


* * 
Description of Treatment 


Test 




X Pre NCE 
(Fall Norms) 


X^Post NCE 
(Sprijng Nonns> 


Actual X 
NCE Gain * 


ATTENDANCE 
RATE (jSTAR 
MINUS TOTAL 
STUDENTS/ 


1976-77 


7 


Block* Classes . - Students were provided with 
one period (approx. 45 min.) each of reading/ 
English, social studies, v mathema'tics, and 
skills reinforcement instruction daily. The" 

r 1 T<t tnVAi (tiki AAtf liAw* A 1 ijnir* a*ti«J>il 

tnroo suDjocts woro anfu/s scnoauiea 
consecutively in a three period block. A 
certificated teacher {or Team Leader) acted 1 
^s the student's homeroom teacher and coor- 
dinated instruction in each of the above 
mentioned subject areas. A mathematics * 
teacher assumed major responsibility for 
mathematics instruction, while an educa^—r— 


CTBS 
Level 3 
Forms 
T-Pre 
S-Post 
(40 items). 


274. 


24.08 

J 

\ 


30^05 

f 

* 


+5.97 
\ 


+5.2* 


— - 




tional ftidfi orovidod <nnnort n<«{«tinrA 

during all Block Class activities. 


- * 






1 






1977-78 


7 


Block Classes - Treatment was identical to 


CTBS 


276 


28.05 


— — f 

33.90 / 


+5.87 

> 


+4.S% 

i \ 






that offered during 1976-77. *A description - 
of the treatment appears above. . 

A * 


Level 3 
Fdrms 
S-Pre 
and 
Post 

(AC\ 1 timet 




1978-79 


7 


Block Classes - Treatment was identical to 


CTBS_ 


211 


30.33 


33.63 


+3.30 


+4.3% { 






that offered during 1976-77 and 1977-78. 
Refer to the 1976-77 Description of Treat- 
ment* 

i 

> 


Level 3 
Forms 
S-Pre 
and 
Post 

(40 items)- 



t . «»»«*iwmi. a SCUUUl /C 

•Objective criteribn-.t least « 2.00 NCB »ean gain (1976-77 « 77-78) and 4.00 NCE >ean gain (1978-79, 79-80. fi 80-81) 
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APPEND I jG*2 (Cont'd) 



Achievement Test and Attendance Results for School Years 1976-77 through 1980-81 



VOCABULARY 



Year 



1979-80 



On 
I 



Gr. 
7 



Description of Treatment 



Block Classes - Both reading/English and 
social srucues/skills reinforcement instruc- 
tion were increased to two periods (appro x. 
90 »in.). Each tw^ieriod subject was sched- 
uled consecutively . with the .Team Leader * 
only assuming instruction' in his/her area of 
certification (i.e., either English or social 
studies). During social studies. non-projeJt 
teachers assisted the Team Uader daily.whil* 
programmed reading teachers daily of^eretf 
assistance to small groups of students during 
English. Team leaders also provided support 
to students in their vocational education 
classrooms. Project aides continued to as- 
sist team leaders during all program ^ 
activities. ; 



Learning Cent; 
one period (45 



_e£ - Students were provided with 
. 1> minutes) of programmed reading 
assistance daily. Instruction is conducted 
by a project teacher who supervises one of* 
five reading programs (i.e.. New Century, 
Communication Skills, High Intensity, 
Hoffman, or Educational Development Lab). 



Test 



SDRT T • 
Brown 
Level 
Form A 
(46 items) 



SDRT 
Brown 
Level 
Form A 
(40 v d tens) 



354 



244 



X Pre (JCE 
(Pall Norms) 



28.29 



32.66 



X Post NCE 
(Spring 



Norms) 



36.09 



32.65 



Actual X 
NCE Gain 8 



+7.80 



ATTENDANCE 
RATE (STAR 
MINUS TOTAL 
STUDENT^) 



.01 



.2% 



-5.5% 



ZIT 1 " TT ° nly th °'" PUbllC SCh001 StUdentS Wh ° rftCeiVCd mR ^™«i°nal treats for a full. scho ol year 
.Objective criterion-* least a 2.00 NCE «e« ^(1*0-77 , 77-78) and 4.00 HCB »ean 8 ai„ (1978-79. 
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APPBNDI* 6-3 (Cont'd) 
Achievement Test' and Attendance Results for School Years 1976-77 through 1980-81 



> 



VOCABULARY 



Year 



1979-80 
(Cont'd) 



Gr. 



Description of Treatment 



Learning Center- Treatment was identical to 
" " ade 7 Center participants, 
description. 



that offered 
Refer to prev 



d to Oca 
evipfc d 



Test 



SDRT 

Brown ^ 
Level) 
Form A 
(40 ItemsV 



Nf 



80 



X Pre NCE 
(Fall Norms) 



33.16 



X Post NCE 
(Spring Nonas) 



30.98* 



Actual X 
NCE Gain* 



-2.18 



ATTENDANCE 
RATE f STAR 
MINUS TOTAL 
STUDFNTSt 



-9.9% 



1980-81 



Block Classes - Both reading/English and 



ON 



social studies skills reinforcement ins true r 
tion was reduced to one period (or 45 min. 
per subject). The subjects continued to be 
schedules .consecutively in one room. Team 
Leaders no longer assumed primary responsi- 
bility for instruction in these subjects. 
These classes were taught by non-project 
' teachers with .team leaders and aides provid- 
ing support "assistance. Team leaders' also 
provided selected students with reading skill 
tutorial assistance during their elective 
periods. Beginning with the second semester , 
Team Leaders and aides were removed from the 
English/social studies classrooms and pro- 
vided project students with one period (45 
min.) o&reading^ipd study skills instruction 
daily during the student's elective oeriorfK. 

Learning Center - Treatment was identical to 
that offered to 1979-80 Grade 7 Center parti- 
cipant*. Refer to 1979-80 description. 



SDRT 
Brown 
Level 
Form A 
(40 items) 



249 



31.08 



32.04 



♦ .96 



< 



4 



1 



SDRT 
Brown 
Level 
Form A 



1*99 



34.61 



35. 4i 



♦ .80 



.8* 



IThe samples include only those public school students who received STAR instructional treatment for a full school year 
^Objective criterion-at least a 4.00 NCE mean gain. , » ^ ' * • 

♦Because Spring norms are not available at the eigth grade level, ninth grade Fall "norms were used to interpret the 
eighth ^rade post scores. ^ r 
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APPBtolX G-4 (Cont'd) 
Achievement Test and Attendance Results for School Years 1976-77 through 1930-81 

2' . ViiqABfiLARY 



.Year 


Gr. 


Description of Treatment - * 


Test 


HI 


X Pre NCE 
(Fall Norms) 


X Post NCE 
(Spring Norms) 


Actual X 
NCE Gaiif 


ATTENDANCE 

KH l c (o 1 AK 

minus total 
studkntS 


1980-81 
(ContM) 


8 


learning Center - Treatment was identical 
to offered to 1979-80 Grade 7 Center, parti- 
cipants. Refer ttf 1979-80 description. 


SDRT 
Brown 
J*vel 
Form A 
f40 items) 


249 

i 


36.44 


34.39 


: 2.05 


+2.31 




9 


' \ s • 

Learning Center >- Treatment** identical to 
that offered Xo 1979-80 Griw7 Center < ■ 
participants.^ Refer to 1979-80 description. 


5DRT 
Brown ' 
Level 
Foim A „ 
(40 itens) 


118 


32. 7S 


37.23 


♦4.48 


♦2. . 








< .v 






X 










* 








\ 






i 




% ; . , • t »i 


• 

» 










« 



Ijhe samples include only those public schqol students who received STAR instructional treatment for a full school year 
SObjective criterion-at least a 4.00 NCE mean tain. y 
•Because Spring norms are not available at the eigth grade level, ninth grade Fall norms" were used to interpret the 

eighth grade post scores. . * 
♦•Because Spring norms are not available at the ninth grade level, ninth grade Fall, norms were used to internret post 

ninth grade post scores. I . 
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Results for School Years 1976-77 through 1980-81 
READING COMPREHENSION 



Year 



1976-77 



r 



1977-78. 



1978-79 



Gr, 



Description of Treatment 



Block Claws - Students were provided with 
one period (approx. 45 min.) each of reading/ 
English, social studies/ mathematics, and 
skills reinforcement instruction daily. The 
first three subjects were always scheduled 
consecutively in a three period block. A 
certificated teacher (or Team Leader) 
acted as thfe student's homeroom teacher and 
coordinated instruction in each of the above 
mentioned subject areas. A mathematics 
teacher assumed major responsibility for 
mathematics instruction, while an educa- 
tional aide provided support assistance 
during all Block Class activities. 



Block Classes - Treatment was identicaVto 
that offered during 1976-77. A descr>f>tion 
of the treatment appears above. 



Block Classes - Treatment was identical to 
that offered during m£-77 .and 1977-78. Re- 
fer to the 1976-77 description of treatment. 



# 



Test 



CTBS 
Level 3 

S-Post 
(45 items) 



CTBS 
Level 3 
Form: 
T-Pre 
and 
S-Post 
(45 items) 



CTBS 
Level 3 
Form: 
T-Pre 

and 

-Post 
(45 items) 



N# 



274 



279 



211 



X^Pre NCE 
(Fall Norms) 



24.26 



26.01 



27. S6 



X Post NCE 
(Spring Norms) 



29.42 



30.99 



30.89 



Actual X 
NCE Gain I 



ATTENDANCE 
RATE (STAlt 
MINUS TOTAL 
STUDENTS 



+5.16 



+5.2* 



♦4.98 



+3.33 



♦4.S% 



+4.3% 



The samples include only those public school stents who received STAR instructional treatment for a full school y 
Objective criterion-at least a 2.00 ^ mean gain(1976~77 « 1977-78) and 4.00 NCE mean g*in(1978-79.79-80,5 80-81) . 
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APPENDIX G-6 (Cont'd) 



> 



r 

Achievement Test and Attendance Results for School Years 1976^77 through 1980-81 



READING COMPREHENSION 



3^ 



.Year 



Gr. 



1979-80 



Description of Treatment 



Block Classes - Both reading/English and 
social studies/skills reinforcement instruc- 
tion were, increased to two periods (approx. 
90 min.). Each two period subject was 
scheduled consecutively with the Tean 
Leader enly assuming instruction in his/ 
her area of certification (i.e., either 
English or social studies). During social 
studies, non-project teachers assisted team 
leaders daily, while programmed reading 
teachers daily offered assistance to small 
groups of students during English. Team 
leaders also provided support to students 
in their vocational education classrooms* 
Project aides continued to assist team 
leaders during all program activities. 

Learning Center- Students were provided with 
~ riod 



one period (45 minutes) of programed read- 
ing assistance daily. Instruction is con- 
ducted by a project teacher who supervises - 
one of four reading programs (i.e., New 
Century^ Communication Skills, .High Inten- 
sity, Hoffman, or Educational Development 
Ub). 

Learning Center - Treatment identical to • 
that offered to Grade 7 Center participants. 
Refer to -previous description* * 



Test> 



SDRT 
Brown 
Level 
Form A 
(60 items) 



SDRT 
Brown 
Level 
Form A 
(60 items) 



SDRT 
Brown 
Level 
Form A" 
feO items) 



336 



219 



6<S* 



X Pre NCE' 
(Fall Norms') 



26.49 



30.12 



27. 54 



X Post NCE 
(Spring Norms) 



Actual X 
NCE Gain* 



31.54 



31.99 



25v00 



+5.05 



+1.87 



-2.56 



ATTENDANCE 
R/JTE (STAR 
MINUS TOTAL 

students) 



.2% 



-5.5% 



-9.9% 



#The sample includes only those public school students who received STAR instructional treatment for a full school year. 
•Objective criterjon-at least a 2.00 NCE mean gain (1976-77 | 77-78) a^d 4.00 NCE mean gain (1978-79, 79-80. « 80-81) 
1h?M^ * th " th ° ^ hth ™- ^ h .norms were used to interpret 
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.Year 



1980-81 



Gr. 



Description 6f Treatment 



Test 



Block Classes - Both reading/English and * 
social studies skills reinforcement instruc- 
tion w/s reduced to one period (or 45 min. 
per subject). The' subjects continued to be 
scheduled consecutively in one room. Team 
Leaders no longer assumed primary responsi- 
bility for instruction in these subjects. 
These classes were taught by non-project 
teachers with ^eam leaders and aides provid- 
ing support assistance. Team leaders also 
provided selected students witb reading skill 
tutorial assistance during their elective 
periods. Beginning with the second semester. 
Team Leaders and aider wer* removed from the 
English/social studies classrooms and pre- * 
vided project students with one period (45 
min.) of reading and study skills instruction 
daily during the students eT*ctive Derioda. 

Learni "g Center - Treatment was identical to 
that offered to 1979-80 Grade 7 Center parti- 
cipants. Refer to 1979-'80 description 



SORT 
Brown 
Level 
Form A 
(40 items) 



SDRT a 
Brown \ 
Level *. 1 
Form A^- 



N# 



704 



394 



X Pre NCE 
(Fall Norms) 



27.39 



X Post NCE 
{Spring Norms) 



'26.89 



31.75 



33,45 



Actual 

NCE Ga 



X 
in Q 



.50 



ATTENDANCE 
RATE (STAR 
MINUS TOTA 
■STUDEXTfr 



.9% 



♦ 1.70 



.8% 



&j&~c£££i*r k ESiJS2 sr* * Wved •»» «-——- ^ twmt hT . Ml sch001 year 

. ; TJX"?™";." 01 aVall " Me at th ° ei ^ h *»* «"de Fall no™ were used to interpret the ' 

'* "Sn^^SrS: tVailaMe " 1— • •*»* ***** «1 "or., W ere used to interpret post , 
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APPENDIX G-8 (Cont'd) 
Achievement Test and Attendanc e Results for School Yeai#1976-77 through 1980-81 

RE ADING CO^REIIENSIOH 



Year 



1980-81 
(Cont'd) 



CO 



Gr. 



Description of Treatment 



Learning Center - Treatment m identical 
to offered to V979-80 Grade 7 Center parti- 
cipants. Refer to 1979-80 description. 



Learning Center - Treatment was identical to 
f hat offered to 1979-80 £rade 7 Center 
participants. Refer to 1979-80 description. 



% 



Test 



SORT 1 " 
Brown 
Level,^ 
Form<A 
(AO items) 

SDRT 
Brown 
Level 
Form A 
(40 items) 



Nf 



661 



119 



X Pre NCE 
(Fall Norms) 



33.33 



30.79 



X Post NCE 
(Spring Norms! 



Actual 

NCE Gai 



31,39* 



,32.47** 



-1.94 



+1.68 



ATTENDANCE 
RATE (STAR 
MINUS TOTA 
STUDENTS^ 



♦ 2.3% 



♦ 2.8% 



\TgXrS^oSTco,i;. n ° t tVti,abl ° * t the *«* ^ ^ *- W» -« were used to interpret' the 

"SS nS^J'SrS: "V**"^ « ^ ni « h «— ™1 no™, were used to Interpret post 
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APPENDIX 6-9 

Achievemen t Test and Attondanco Results for School Years 1976-77 through 1980-81 

MATHEMATICS COltPUTATION 



Year 



Gr. 



Description of Treatment 



Test 



N# 



X Pre NCE 
(Fall Moras) 



X Post NCE 
(Spring Norms') 



Actual X 

NCE Gain! 



ATTENDANCE 
RATE (STAR 
MINUS TOTAL 



1976-77 



Block Classes - Students were provided with 
one period (aonjjpx. 45 min.) each of reading/ 
English, sociar studies, mathematics, and 
skills reinforcement instruction daily. The 
first three subjects were always scheduled , 
consecutively in a three period block. A 
certificated teacher (or Team leader) 
acted as the students homeroom teacher and 
coordinated instruction in each of the above 
mentioned subject areas, a mathematics teache 
assumed major responsibility for mathematics 
instruction, while an educational aide pro- 
vided support assistance during all Block 
Class, activities^ 



CTBS 
Level 3 
Form: 
T-Pre 
S-Post 
(48 items) 



274 



32.30 



40.74 



+8.44 



STUDENTS> 
+S.2* 



X 



1977-78 



Block Classes - Treatment was identical jto 
that offered during 1976-77. A description 
of the treatment appears above. ' 



CTBS 

Level 3 . 
Form: 
S-Pre 
and 

Post ^ 
(48 items) 



271 



34.93 



42.38 



1978-79 

; 



B , loc k 5i ass . os " Troatnent wa3 identical to 
that offered during 1976-77 and 1977-78. Re- 
fer to the 1976-77 Description of Treatment. 



41.36 



+S.16 



CTBS 233 36.20 

Level 3 
Form: 
S-Pre . 
and 
Post 

(48 items) 



f TM samples include only those public school students who received STAR instructional treatment for a full *ear 
• Objective criterion-at least a 2.00 NCE mean gain(l976.77 * 1977-7S) and 4.00 NCE mean gain (1978-79). * 



+7.S4* 



+4.S* 



+4.3* 
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APPENDIX G-ltfCont'd) 
Achievement Test and Attendance Results for School Years 1976-77 through 1930-81 

MATHEMATICS COMPUTATION 



fir. 



Description of Treatment 



Block Classes ; and Learning Center -Mathema- 
tics computation instruction was no longer a 
responsibility of STAR personnel, (project 
students obtained such instnictioni&sga part 
of the general school program. fttalqStently, 
student achievement was not evaluate 



Blo 9 k dlapsea and L earning Center - Mathe 
matics computation achievement was not 
evaluated. n -*- 
1979-80. 



Refer to explanation appearing 




Test 



N/A 



N/A 



Nl 



X Pre NCE 
(Pall Norms) 



X Post NCE 
(Spring Norms) 



Actual X 
NCE Gain Q 



attendance 
Sate (star 
minus total 

.STUDENTS 



.172' 



173 



APPENDIX 

Achievemen t Tested Attendance Results for School Years 1976-77 through 1980-81 

EVERYDAY SKILLS (REAPING? ' 



.Year 



1976-77 



1977-78 



1979-80 



Gr. 



Description of Treatment 



Block Classes -Students were provided with 
one peripd (approx. 45 min.) each of reading 
English, social studies, mathematics, and 
skills reinforcement instruction daily. The 
first three subjects were always scheduled 
consecutively in a three period block. A 
certificated teacher (or Team I Leader)actod 
as the student's homeroom teacher and co- 
ordinated instruction in each of the above 
mtntioned subject areas, A mathematics 
teacher assumed major responsibility for 
mathematics instruction, while an educa- 
tional aide provided support assistance 
during all Block C^s activities. 



B i lock IL US3 f 3 —Treatment was identical to 
that offered during 1976-77, A descrip- 
tion of the treatment appears above. 

Block Classes -T reatment ws identical to 
that offered during 1976-77 and 1977-78. 
Refer to the 1976-77 description of treat- 
ment. 



Block Classes-.B oth reading/English and 
social studies/skills reinforcement instruc- 
tion were increased to two periods, (approx. 
90 rain.) Each two period subject was 
scheduled consecutively with the team 
ladder only assuming instruction in his/her- 
area of certification (i.e., either English 

or social studies). During social studies 

_ — — — 



Test 



EST 

Test A * 



EST 
Test A 



EST 
Tost A* 



277 



EST 

Test A 



288 



290 



199 



X Pre Raw 
Score 



23.58 



24.08 



25.91 



26.32 



X Post Raw 
Soore 



30.05 



29.30 



29.89 



30.27 



Actual X 
NCE Gain 8 



+6.47 

t-11.53 

P<>.05 



+5.55 
t°7 % 46 
K^.OS 

+3.98 
t=4.27 
p< .05 



+3.95 
t=»11.62 
P< .05 



ATTENDANCE 
RATE (STAR 
MINUS TOTAL 
STUDENTS ) 



+5.2% 



+4.5% 



+4.3% 



.2%. 



• The Everyday Skills Test (ESTJ in reading contains a total of 45 items. 
! 2J*^m?f2^" ^ftcant increase ( p*.0S) in pre/post EST reading mean raVscores 

». samples include.nly those students who received STAR skills reinforcement instruction for a full school year 
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• APPENDIX C-l}Cont»d) 

Achievement Test and Attendance Results for School Years 1976-77 through 19tflT-81 

EVERYDAY SKILLS f READING) 



.Yea* 



Gr. 



Description of Treatment 



Test 



N» 



X Pre Raw 
Score. 



X Post Raw- 
Score . 



Actual X 
NCE GaiiP 



ATTENDANCE 
R ATE (STAR 
MINUS TOTAL 
STUDENTS) 



1979-80 
(Cont'd) 



non-project teachers assisted Tea* Leaders 
daily, while programmed reading teachers 
daily offered assistance to small groups ofb 
students during English. Team Leaders also 
Provided support to students in their 
vocational education classrooms. Project 
aides continued to assist team leaders 
during all program activities. 



1D79-80 



Learning Center- EST testing was not conduc- 
ted because the STAR curriculum did not 
include skills reinforcement instruction for 
Grade 7 and 8 Learning Center participants. 



N/A 



1980-81 



Block Classes - Both reading/English and. 



social studies/skills reinforcement instruc- 
tion was reduced to one period (or 45 min. 
per subject). The* subjects continued to be 
scheduled consecutively in one room. Team 
Leaders no longer assumed primary responsi- 
bility for instruction in these subjects. 
These classes were taught by non-project 
teachers with Team Leaders and aides pro- 
viding support assistance. Team Leaders 
also provided selected students with reading 
skill tutorial assistance during their 
elective periods. Beginning with the second 
semester, Team Leaders and aides were removed 
from the English/social studies classrooms and 
provided project students with one period (45 
min) of reading and study skills instruction 
daily during the student's elective periods 



EST 

Test A* 



708 



25.48 



28.98 * 



♦3.50 
t«10.54 
P<;.05 



♦ .9% 



• The Everyday Skills Tost (EST) In reading contains a total of 45 Items. 

• Objecltve criterion-significant Tp-S.OS) in pre/post EST reading aean raw scores. t 

• The samples Include only those students' who received STAR skills relnforce«ent instruction for a full school year. 
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APPENDIX G-13 

4 

Achievement Te^and Attenda nce Results for School Years 1976-77 through 1980-81 

EVERYDAY SKILLS (STUDY SKILLS) 



Year 



Gr 



1976-77' 



1977-78 



197&-29 



1979-80 



Description of Treatment 



- Block Classes - Students were provided wfth 
one period (app*ox.4S min>) each of reading/ 
EnglisJu social studies, mathematics, and 
slills Reinforcement instruction daily. 
The X f irst three subjects were always 
scheduled consecutively in a three pferiod 
block. A certificated teacher (or Team 
Leader) acted as the student's homeroom 
teacher and coordinate*} instruction in eactf 
of the above mentioned subject areas. A 
mathematics teacher assumed major responsi- 
bility for mathematics instruction, while 
an educational aide provided support assist 
ence duri ng all Blo ck C lass activities. 



B jj ck Classes - Treatment identical to that 
ottered during l£76-77. A description of 
jthe treatment app ears abo ve. 

Block Classes - Treatment identical to that 
Offered during 1976-77 and 1977-78. Re£er 
to the 1976-77 description of treatment. 



Block classes -Both reading/English and 
social studies/skills reinforcement instruc- 
tion were increased to two periods. (Appro*, 
90 min.). Each two period subject was , 
scheduled consecutively with the team* 
leader .only assuming instruction in his/her 
area of certification (i.e., either English 
or social studied). During social studies, 



Test 



EST 
Test B 



EST 

Test B' 

EST ^ 
Test B * 



EST 

Tost B* 



309 



269 



197 



274* 



X Pre NCE 
r(Fall Norms) 



25.31 



19.06 



19.09 



20.99 



X Post NCE 
(Spring Norms) 



JS.27 



24.68 



. 21.88 



22.01 



Actual X 
NCE Gain 



ATTENDANCE 
KATE(-STAR 
MINUS .TOTAL 
STUDENTS) 



+9.76 



+5.2% 



+5.62 



+2.79 



+4.5% 



+4.3%- 



+1.02 



+4.3% 




APPENDIX G-14 



Achievement Test and Attendance Results for School Years 1976-77 through 1980-81 



EVERYDAY SKILLS (STUDY SKILLS) 



Year 



1979-80 
(Cont 1 ^ 



Gr. 



Description of Treat pent 



non-project teachers assisted team leaders 
/daily, while programed reading teachers 
daily offered assistance to snail groups of 
students during English. Teas leadeVs also 
provided support to students in their voca- 
tional education classrooms. Project aides 
continued to assist team leaders during all 
program activities. * 

Learning Center- EST testing *as not conduc- 
ted because the STAR curriculum did not 
include skills reinforcement instruction 
for Grade 7 and J} Learning Center partici- 
pants. v . 



Test 



N/A 



N# 



X Pre NCE 
(Pall Norms) 



X Post NCE 
(Spring Norms) 



Actual X 
NCE GaiT»$ 



1 



ATTENDANCE 
RATE STAR 
MINUS TOTAL 
STUDENTS 



jjlock fi lasses 
social 



•Both reading/English and 



studies skills reinforcement instru- 
tion was reduced .to one period (or 45 min. 
per subject). The subjects continued to be 
scheduled consecutively in one room. Team 
Leaders no longer assumed primary responsi- 
bility for instruction in these subjects. 
These classes were Xaught by non-project 
teachers with Team Reader and aides provid- 
ing support assistance. Team Leader also 
provided selected students with reading 
skill tutorial assistance during their elec- 
tive periods. Beginning with the second 
semester^ team leaders end aides were re- 
L' moved from the English/ social studies class* 
rooms and nroVided prbject students with one 
period of rearilrp and study skills instruc- 
tion dj^p during the students elective^ 



EST 

Ttit B*, 



668 



21.80 



22.81 



♦1.01 



Jhe Everyday Skills Test (EST) in Study Skills contains d total of SO items. '* • *~ 

nM JJTSl* 8 1 includo onlv those students who received STAR skills reinforcement instruction for a full School year, 
uojectice criterion-at least a 4.00 NC? mean gain,.- 



loU 



isi 



I 




APPENDIX ■ H" 

Pupils Served and Per Pupil Cost in Project STAR , 

from 1976-77 through 1980-81 , 

*- ' * 

; 1 - .y 

PROJECT TOTAL TITLE I NUMBER PER PUPIL 

. YEAR EXPENDITURE "PUPILS SERVED * COST 



1976-77 


$ 867,728 

< 


864 . 


$ 


1,004 


1977-78 


$ 912,523 


892 


i 

% 


1,023 


1978-79 


$ 1,134,284 


1,256 


% 


903 


1979-80 


„$ 2,549,470 


3,110 


% 


. 820 


1980-81 


$ 3,043,089' 


4,123 


•% 


741 




j > 
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APPENDIX I 

Title I Project STAR Survey Questionnaire 
Summaries for 1980-81' 

b 

1. Public. School Project Teachers 

2. Non^Public, School Pro j ect "Teachers 

3. Educational Aides* \ 
^4. Public School Parents 

5. Non- Public School Parents 
-6. Block Skills Reinforcement Students 

7. Learning Center Students 

8. Non-Public Students 



r 



IS3\ 




APPENDIX 1-1 

ar.vniAKu vm.ic schools * 

;)ivisujb o£ P-jscaxch aiul we\ clopsieM 



f ' 11*80-01 TI'ILM. t P!:OJUCT S'JAK CLASSES 

Sur vey oi ' Pr oject Teache rs 
N=42 

SQICOL o DATE : 



1 . TEACHING ASSIGNME NT 

Plea5e indicate your current teaching assignment by placing a M V in front 
^ of th* description i/nich applies. 

37i Block (Skills Reinforcement) 37% Learning Centef A 



• l%.No Response • 1% Learning Center B , 

24% Learning Center C 

ft m „ m. 

2. PEOJ ECT QPg Pw\ TI0^ . - * 

— — — > 

a. Ttfd yea encoarter difficulty scheduling student* into ycur Troject ~* ^/ 
STAR classes? , 

' " • 64% Yes 36% No 

*\ .If ^Yes 1 ', descrite the difficulties you experienced. Students strongly 

objected to being arbitrarily remtoved from their elective classes , Students 

were not programmed into the Center whon the ma rtyr sfh<»diilft was made.., j 

No help obtained from Guidance Dept., teacher had to schedule all students 

^ 'into <c enter. ~ 
■f 

. • How %cro the difficulties'listed above resolved? (l£,they *t$? no-; *• 
rctolvcd, please explain vhy). 

Teacher and aid e had to get permanent record card, review scores and sche dule 

s tud^n ts. . .Student resentment lingered severa l weeks un t il they.realized 

that th ey were m>t going btfc* to thc -ir e lective class. . . Everyone felt it wa s 
someone "else's rcsponsibiUty"lo riTT"tn'c r "Center to 'capacity v . . » 

^ " b\ Did you find i: neccscari to va\Vo adjusi^c^.t:? in your fvjchiv.n xs'a I 
, „ - rrsult of the £rc«5» cr 'heterogenous racial composition oi" students a 
withiu your STAR classes? , w * 

7% ff es • * . v 93V ho 

i - 1 1 1 

• If "Yes'*, briefly deserve nntwe>of the sdi'istnents tjhat were zuda in * 
your teaching. ' , ^ 

t had to use a wider range of mat eriai ... Introduced games as a means of 

getting all students acquainted 'with each other... West Side students are 



*jtt f f ic ult to tnotlvntc and their nhscn tec rate from school is ama2ing . 



APPENDIX 1-1 (Cont'd) 



for mx>ci: (ou sKjfta iu.iNroKaju nt) uAGin'w only 



C * 'the ISlii T' U r ; MC * U, V nlUC ° f "«-"*nr. operational features of 

the project in teres of promoting student learning? 



Block teacher's presence in 
the English Classioon 

Block teacher's presence in 
the social studies clasr.roo* 

Meetings held vrith your STAR 
tcaa (i.e., involving the 
block teachers^ resource 
teachers and aide) 




25% 



19% 



Much 
Value 

38% . 
3S% 



Soac 
Value 

25% 



19% 



little or. 
No Value 

12% 



31% 31% 



12%' 



6% 



No 

Response 



6% 



mL\ if :?*?) thC ? r ° ni rrffcstcr orcaniration,l clang? (i.e.. fro* 
? i rcinforctMnt hatt on*ho quality of inst™- 

tioi.nl assistance you could provide to >our STAR student*' 



31% 
very 
^positive 



positive 



no 

effect 



negative 



vory 
negative 



3% 



19% 



. Briefly, describe hov tha change affected tho instructional 
^ assistance you vcro^able to provide to your STAR studeurs. 



No 

Response 



Able to w ork with students In smaller grouns and could con- 
centrate on skills instead oT subject areas ... Change hinder ed 
Mtiiflmf rnn^fer . nf rhft 1^ si»n« r 0 aca dOT t1 r,, i3ibjfrt i .* 



^ ^fi^ fCC w?{ d """^"^ter organisational chanre (i.e., fa 
ulni^t *^*««*nt classes) have on your jjfcR uudtrts' ■ 





6% 



effect J 



very 
negative 



Briefly, describe tow tho change influenced Your STAR students' 
learning. * ^ 

y * 

-Able to provide more Immediate feedback. . .Pace of instru ction 
and cont ent was acre adapted to each student's need. . .Many 
students resented having to constantly work on worksheets 



13% 

No 

Response 



Indicate hov aany of your STAR students' parents ro^micjted to you- 
their feelings regarding the organizational change. v } 



82 (or_2Al_.out of a total of $34 jwrcnts 
Of those vho corr.mie.itrd their Vrelinrs to >w«. vhr.t porconta-c *f 

!ft««M ar H , . r ? , ? ,n,le ' ,tion ' eo,lld ela$slf i«* ,n of tk« 
catof.orits listed below? 



50% 

grticTTniy 

positive ft 
fcrli nns 



gt » jvril" I y" 
fc t»l fugs 



• 6%_ 

pnu'T.i I Fy* 
negat ive 
feelings 



.at. 

No 

Response 



■178- 
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APPENDIX 1-1 (Cont'd) 



FOR LEAR"7Nt; V$XlTX\ lUACHLKS 0&,Y 
S*26 



How appropriate was the iinount of time students were required to' attend th<\ 
the Leamisfs Center (i.e.*, on a doily bis5\s during the entire school year) 7 



4% 



31% 



Much Too. A Little ■ ^ About Too Uttlc 

Much Time * Too Much Right Time 

, ^Time 

. No Response 1% 
. Please explain, if your response was other than "About Right" 



Much 'loo 

Little 

Time 



It appeared necessary to rir> activities nntgiHp th* Centurv program. 
the same lab format became aonotomous .. .More rel^vf*^* tn ^*h />y g^^r 

work so that_the student understands the significance of^the lab work.. 
Children lost enthusiafc after the first semester.,,. 



EDUCATIO NA L AIEE \ N*42 t 

How ^dc^icite were the supportive service's prided by your aide? Indicrtt 
youv response by placing a check in the column which' no st closely 
eorrespo:.ds to your opinion, * 



Ability to do assigned work 
Willingness to do assigned work 
Quality of actual job performance 



More Than 
Adequate 


Adequate 


Less Than 
Adeatiatc 


No 

Response 




24% 


5% 


7% 


69% 


21% 


2% 


• 3% 


60* 


29% 


' 5^ - 


6% 



Comments: ,AietQS_Jxec th* t e acher tn vnrV ^nxii\ddually with stndrn t 
Aide did no^ respect the teacher as her boss...Mv aidg w* < inM q££ at tha 

end of the first sem ester. . .This Kad a very negative impact on the quali ty 

of services 7 ! . . $j 

INSTRUCTIONAL AIDS 

Instructional materials and supplies (book5 
by the project. are: 



, work siippl'^S^ctcO provj 



Appropriate to the learning levels of project 
' students „ 

Useful in achieving project objectives 



Yos 



93% 
90% 



>ded 
No > 
HO Respons 

T - 7% 

10% 



No 



Yes * No 



. 90% 


7% 


3% 


83% 


12% 


5% 


of interest 


to eiTls than bovs. 





APPENDIX 1-1 (Cont'd) 



1 N\ST!WCrtONA[.*A Uif> * continue*! 

Relevant to t\ie interests of project 
students ' 1 ^ 

Adequate in quantity 

1 Comments r Tt^T S s e cerns to be more informat 

fith students attending Centers for five days there is a need for m or e mat er i a 1 s 

in certain comprehension skill areas, . * It was very difficult to r eproduce whole 
"workbooks in *the Center when additional copies were needed. . .txcelTent variety. 
ATTITUDES- OF FACULTY , ' 

In your opinion, what value do, the faculty members in youv building 
place on Project STAR'S efforts to -improve student ^reading? 

f 

6% Essential 

t 45* Much Value 1 " 

t % ^ 40V Sor.c Value 

71 Little or No Value 
4% Ho Response 

Comments: t offf>n f»»i f ami ty wAinhgrg v^s'+nt mv cA ass 'sizes . . .Many teachers 
have no ide a what Learning Center does, we need to introduce what we do to the 
Equity. . .Outside of the department,^ teacher knows little about what I am doing.. 

"Sowe^lue^the program highly, some do not... The faculty has been generally support' 
PKOJRCT INSERVIcE EFFECTIVENESS 

a. please indicate the total number .of project sponsored inservice 

meetings which you ^attended this year. ( 

Av. pel "teachTr .JLL. ^^Sa^:" 10 " 8 """^ ^ * ^ ' ' ' 

b. In terms of your own classroom instructional necds^ how hclJBTaid X°u 

„ fiiyl the information that was presented -at Pro jeer STAR inservice 
sessions held throughout the year? x *• 

Very " Somewhat t Kot < Mo 

57% Helpful 31% Holpful 10% Helpful -~ Helpful 2% P .espons 

c. To what extent did your classroom instructional* approach change as a 
result of attending theHc project sponsored inservice sessions? > 

7% A Lot 79% Some ° 12% Not Much — ' None 2% -No Respons 
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APPENDIX 1-1 (Cont'd) 



6. > PRn.n:cT iNsr. KVTC!- nyrcrTvrvius q - continued - f 1 

d. Iri planii'nc* for in service next year, what rcconmcud.it ion would you 

make regarding each of the it fins listed below? 

9 a w x a Continue No 

• LHtercasc ' As Is * Decrease Response 

* J" , 

Number of. sessions offered • * 26% 62% 5%' 7% 

~T r * : _ - : rn~ 



* Variety- of topics 40% 50% . 10% 

' - Time $ncnt presenting each topic ,17% 71? , 5% 7% • 

Sessions that provide suggestive 

n * teaching strategies 62% 31% . 7% 

. . _ . » ' ' ■ 

Please describe additional inservice recommendations you would like to sec acted 
upon. 

» 

. 'More"disclission on reading strategies to help non-readers. ^Learning Center 
• students s hould have more assistance learning t o t ake standard » »,i test*Jforc 
^^^ "gs designed^to aeot the needs of the very slow reader. Jfore concrete ill ation 

. g*ven on various activities to help.motiyate students,. .The-aeetings were vr- he'n^i 
7. . PROJECT EFEECTiyEXESS - . »~«ings were v„r> ae.p.ul. 

a. * In x our opinion, what siaglc feature of the project has contributed 

most to classroom, effectiveness (in terms of improving pupils 1 
" learning}*? . 

Small classes and educational- aide assistance. , . Flexib ility in format and 
structure which allows instruction to be adapted to individual need s.. , ^ 
Sequential progression of skill building provided by the materials 

b. In your opinion, what single factor has been most detrimental (or * 
contributed least) to pupils 1 * learning? 

■ Lack o£*parental t contact on the part of the educational aide. . .Continual 

a* M 1- T3 1 ■ 1 1 1 wm m ■ 

' x * v use of machines, there -is a pointof ^iain is hlng returns. « .Poor stud ent) 
** " "V 

attendance. ...Difficulty in aptivatjng students if the y kno w they are not 

. r ^ • * * getting a, gTade. ...Lack of variety in format of New Century. 

c. What changes would >*ou rccoL«ner.J be awue xn Ln6 pvay.Ct lo innrovo rtrc 
services offered to students? * - 

Homeroom with lab teacher for better attendance. AMore connection to 
subject classroom. . .Lab services curtailed 'to only ono semester. Second 
A semester move students into another area of reading outside the lab... Give 

1 , ■ i 1 

grades... The cducationajl aide should be responsible for needed parental 
contJfrt. . .Make sure students have STAR class written on their schedule when 
they receive it at the beginning of the semester. 
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APPBNDLX 1-1 (Cont'd) 



pho.ii cr ?.i;fTCTTvr?v'i-.sr. - continued 

d. Uccord any additional comi.ionts you would like to make about the $ 

operations of the project. t 

Supp ort and ass istance always see ms- to be av ailable in this project. 

I really appreciated the close contact with program management, . .1 

feel that changing the Block concept has destroyed to some extent 

the basis fox the existence s>f the program. To me, changing this 

program has.fone a great injustice to the learning process of some 

r of our youngsters. As Transij^on and STAR Jiave changed in recent " 

years we have lost many worthwhile aspects of Jthe old program. The , 

amaount of involvement among te am leader, ai de, and student s has be en 

diluted. We are no longer able to follow- through on application of < 

s kills in the content a rea classroom. .. The progr amming of st udents 

into tfre centers would be a p ositive act. Th e stu d ent's ^att itude 

become s negati ve wheti he is pulled fro m ^ qlass .., ♦ X ' am most *nthusi astic 

about th,is reading progra m x _\% works!* It has great potential. It is 

. efficient and w e 11 -run. . .More meetings wit h^J^QPl^^_the_s^e^SJSignment 
as yourself to exchange ideas, « successes and failures. ..Learning Centers 
Have the "Dumb Kids 11 stigma. This should be Changed with cooperation from 
faculty by "selling" the Center to students who have reading problems. .. 
There should be a way to schedule Project STAR classes in one uniform manner. 
A very excellent project in determining a child'* level of reading. . .Problems 
were easy to identify because of the. close contact with the students... I was 
given no training during the free two -week period before school began. This 

time could have been spent preparing for a program which I know absolutely 
nothing, instead wc were< expected to attend make-shift "training sessions 11 
on Saturdays...! am impressed by the interest the students have in the program. 
Despite *he fact that by now many students are beginning to get' bored and 

tired... they have been sufficiently motivated throughout the -year. ' 
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\ APPENDIX 1-2 

CLLVHAM) PUULIC SCHOOLS 
Division of pesc-irch a:M Development 
June, 1931 



SCHOOL 



1980-81 TITLE I PROJECT STAR CLASSES 
Survey of Non-Public Project Tcschc? 4 :; 



N=15 



DATE 



1. PROJECT OPHPATIOKS 

Did you encounter difficulty scheduling students into your Project STAR 
classes? 



53% yes 



47% No 



If "Yes", describe the difficulties you experienced. Some teachers resfe ted 
the kids being taken out for Project STARhelp, . .The sase children were 

also assign ed t o the van and were missing too man y classes. .. 6-7-8 are I 

departmentalized - schedules conflicted. — 
How were tnc difriculti^s listed above : 

resolved, please explain why.) 



resplved? (If they were net 



Reorganised my scheduling. . .Th* HH« wn^ t 3 V m n„t a » M ffmnt r *«\f^ 
during the S days thereby missing only one day for any particular sub ject 
2. INSTRUCTION AIDS 



Instructional materials and supplies (books, *ork supplies, etc.) provided 
by the project are: • 



Appropriate to the learning levejs of project 
students 

Useful in achieving project objectives 
Relevant to tha interests of project students 



Yes 
99* 



No 



100% 



100% 



100% 



No 

Response 
1% 



Adequate in quantity t / 

» Comments: More material .of high interest /easy reading that would inter est } % 

the upper levels would be beneficial .. .The~Hoffragh materials were appropriate 

to the learning levels, but of low interest to the* students. . . I be lieve tnc 

materials wore more thlm .ad equate. . .Materials _arcgp o_d! I love the thinking 
reasoning workbooks sucit as Footsteps., Clouds, Prating, etc!.,. The rnat?\ • 



materials were too* sim.pR» and inadequate. It was necessary to purchase my 
own workbooks. 
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) , . APrr.NDIX 1-2 (Contrf J) 

3. Afn-pin:,:; or f/u.ih/iy 

— — , ^ « -v 

In your opinion, ».hat value Co, 1 he faculty members in your building place 
on rrcject STAR'S x cf forts to improve student! leading? * 

27% Essential 



53*. Much Value t 
40^" 1 "' Some Value , 
Little or tfo Value I 

foments: Most teachers were very receptive to the program. . > I^feel 

classroom teachers often find staking children out of their class more of < 

a distraction than an aid. . .The faculty opinions here run ' the* gamut of 
'•very useful" to "get rid 4£ it". * _ ' 

4. * PROJECT INSERYIO: EFFECTIVENESS 

- f 

a. Please indicate the total number of project sponsored inservice 
coatings which you attended, this year\ , * 

7.5 Average number of sessions attended 
by a typical hon-Dublic STAR teacher 

b. In terns cf your own classroom instructional naeds, how heJp^ful^id you 
fi^o the inforriarion that \ras present^ at Project STArt inservica 
sessions hold throughout ;the. y«ar?* 

; Very Somewhat Kot 

60% Helpful 40%„ Helpful --- Helpful Helpful 

c. To what extent did your classroom instructional approach change as a 
result of attending these project sponsored inservice se^ions? 

J 

, 53% A Lot • 67% Sone -~ Not Much — None 

• N .' 

d^ In planning for inservice ucxl ytfar, what recommendation would you 
make regarding each of the items listed below? 
* 



Number of sessions offered 
Variety of topics 
Time spent presenting each topic 
-Sessions that provide^ suggestive 
teaching strategies 





Continue 




^Increase 


As Is* 


Decrease 


13% • 


87% 




47% 


53% 




13% 


'87% 


£ 


47% 


53% ' 





Please describe- additional inservice recommepdations you would like to. see acted 
upon. ' 

The sessions were excellent. Most helpful were the discussions about individualized 
instruction. .♦ Have all-day meetings every other month ^instead of half day meetings 

f every month. . .Allow teachers to pick-up an d, return metcrials befor e and after inservice 

sessions. .. Interprqtations of standarized test results. ♦. Better sessions on diagnosing 
math ski lis . ' 
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• APPENDIX 1-2 (Cont'd) 

PROJECT HOTCTIVENfiSS 

a. In your opinion, what single feature of the project has contributed 
most to chissroom effectiveness fin terms of improving pupils 1 
learning)? 



b. 



Individualization of instruction. . .Working with students in small 
groups. I .The material provided by the project was very effectiv e 

in aiding the pupils . ,,.Abi lity to adapt to noh -public needs wit hout 
being hampered by unnecessary regulations ... Inservice meetings 
In your opinion, what single factor has been most detrimental (or 
contributed least) to^F 11 ?* 1 ^ 1 learning? 

Meeting project students five times a wee k might be too m any times 

a poor student" has to miss his regular classes ... Lack of motivat ion 

on. behalf of- the students. . .Teacher's and principal's attitudes .. . 

c. What changes would ycu xecoraaend be made in the project to improve the 
services offered to rtudents? 

$ ' * 

.Encourage schools to have STAR as a substitute for a subject rath er 

than a^an addition to their. regular cla ss es... A nanadatory_PjIgI lt 

f»*«\*n te< frypijH Tt rh* p^g^™ — fifft a r o rnmi trftft .-fcogc r . hf t to . or ganize 

d. RecoKn^SJftioral cosnents you wcul^liVe to -make about 
the opera dons of xho project. % * 

* ftmi* "parent < hav» piilW th ftir children mit of tffl^ttro-ject In hQPes 

that they won't fail, thinking that if .the child, is in his home- 

t _ — 

room all day he won't miss anything and therefore pass... The 
. organization of the project is excellent...! enjoy working in y 
Project STAR and I've written to Washington to' have y funding kept in 
.the fede rall y funded educational projects. * . More math material*, are 
' ffigeded. *'. Perhaps a more involved report car,d should be sent to th e 
_ ' parents to inform them more adequately. . .Would rather have inserv ice . 
meetings in the afternoon. » -Working in Project STAR was a very 
rewarding experience because I was able te individualize and ha d avai 1 - 
able to me a great deal of material with which to work. ..I haye 
thourou ghly enjoye d the pro gram and have fgund individualiz ing . 
instruction challenging. " 
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CU-VMJVND PUBLIC SCHOOLS APPENDIX 1-3 

Division of Research and Development 
H1S0-S1 ■ 

f SURVEY OP EDUCATIONAL AIMS SKKVIKG 

title i rnojrcr star ci^ssrs 

N=40 

SCHOOL L_ 

YTARS OF SERVICE ^ 

Number of years (including the present year) ,for which you have served as an 
aide in this Project : 

One Year 

20% Two Years 
12% Three Years 

More Than Three Years 



ACTIVITIES OF EDUCATIONAL AIDES 



In thcvcolumn below, 
check the thTee activ- 
ities which involve 
the greatest amount 
of your time. • 



In the column belo* 
check the three ac* 
ities which involve 
the least amount o: 
your time. 



lo Clerical assistance (marking 
papers , duplicating materials, 
etc.) 

2. Helping pupils on an individual 
basis. 

3. Working with pupils in small v 
groups. 

4. Supervising class (during study 
sessions! lunch period, etc.) 

5. Conferring with parents via 
telephone. 

6. Conferring with parents via 
c home visits. 

7. Conferring with paronts via 
. school visits. 

8. Conferring with teachers of 
pupils in project. 

9. Other (please specify) 



17% 



27% 



20% 



4% 



17% 



3% 



5% 



6% 



1% 



14 i 



1% 



6% 



22% 



•7% 



• 15% 



13% 



15% 



7% 



(Specify) Taking care of classr oom 
equipment .keeping lab clean* 
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CLEVELAND PUBLIC SCHOOLS % APPENDIX 1-3 (Cont'd) 

Division of Research and Development 1 
1980-R1* 



£ W2r^t£t:&r ^ aSSiiinmC,,£S in ' cludc J«tic S ^hat are related 



4 



— SSV^ Yes ^ 40* No frft No Response 

* If "yes" / 

~r , , breakfast assistance. . .assist in cafeteria... 
fiftture of duties e.g., workin g in office. . staying with tardy students 

Average number of periods per week ^5 periods 



[IMPORTANCE OF ACTIVITIES 

In the column below", check the 
three activit;' 
of greatest b< 
STAR students. 

1. Clerical assistance (marking papers, 
duplicating materials, etc.)" 



three activities which you consider 
of greatest benefit to the 



2. Helping pupils on an individual basis. 31% 



3. Working with pupils in small groups. 26% 



4j Supervising class (during study 

| sessions, lunch periodf, etc.) 2% ' /\ 

5. Conferring with parents via telephone. 2 0% 

6* Conferring with parents via home\visits. 4 * ^ - 

7l Conferring with parents via school 
visits. 



. S. Conferring with teachers cf pupils in 
project. r > 

9. Other (Please specify). 

\ - 



6% 



4% 



. SUPPORTIVE ASSISTANCE p 
% what extent have the services of the^oci.l workers been 0 f help to you? 



* CLEVELAND PUBLIC SCHOOLS 

Division- of Research and Development APPENDIX 1-3 (Cont'd) 
19S0-81 > 

What reconunendations would you make that may improve upon the support assistance 
the social workers proviS^Co STAR class students? 

<* 

The social workers' should visit the class more often so that the students can get t o 
know them better .Social workdrs have done an outstanding |ob in meeting the needs 
6f students outside the school environment. . .Working with more students at one time . 

PROJECT EFFECTIVENESS 
* » ^^^^^^"^ ■ ■ 

What types of additional training and/or information would be of service to 
you in your work as a educational aide in this project?, 

I would like to receive additional training in dealing with behavior/discipline 

problems. . .We^have received enough training. .. Inservice training when new material 

is to be introduced in the classroon. . -Workshops aimed at helping us become more 
effective in teaching reading ^ ^_ - ' 

What has been the 'greatest problem yoiTh&ve encountered in your duties as an 
educational aide? 

• % 

Failure to be able to communicate with some parents when it is needed. . .Student 



absent is im. . .WoTking with students who are bored after being in the program awhile . 

Students who fail to work up to their potential especially after not being able to 
issue report card grades. . . I haven't encountered any real problem^ 

What changes would you recommend to improve this project? 

Methods should be devised to have parent^ tflkfl a greater interes t their child's 

Jgrogress. . . I would recommend that a grade be g^ven on the student *s report card to 

V 

show their achievement ,and progress in reading. , .The Desegregation Community 

Coordinator- should be more involved in out PAC meetings/. .All aides resume the 
responsibility of home visits again. . .Give students a little more variety because 



they complain about doing the &me work after they have been in class a whole 
semester. / 



!9r,. 
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APPENDIX 1-4 
Public School Parent* Response Summary 



Cear Parent 
us 



N=505 



uc arc currently developing plans for next year's Project STAB prograo. You can help 
In this planning by responding to^thc questions appearing below. Your response to these 
•questions should be based upon the kind of experiences your son or daughter has had 
during the current school year. Please answer the questions according to'how you kontfatlv 
feci about thea. . I * ' , — 

MC» YOU COMPLETE TWS QUESTIONNAIRE HAVE YOUR SON OR DAUGirTCR RETURN IT Tfl'liie. 
OR lltR PROJECT STAR TEAOICR. . W«nw tT TO HIS 

1 IfcanJc you for your cooperation 



,I iE$ W ?. WW CV CIKCLT.VG THE LETTS* tniKlf 

most aosziy copzsnws to ma w£sr mlm\ 

l. Has you child talked to you about 
his/her STAR class this year? 



2. How did your child seen to feel about 
*~ his/her STAR class dni-ing the first 
school 5 cheater? — 



a. Yes 

b. Ko 

c. No Response 



67% 
13% 



Coawiartnj this year to 'lost year,! feel 
*V child is doing: 



«- Seeaed very satisfied. ^ 

b. Seeaed acre or Its* satisfied. 

i 

C Undecided. \ 

d. Sitwd »or« or less dissatisfied. 

e. Seeded very dissatisfied. 

f. No Response » 

5. How did your child seta to feel about 
his/her ST A* class during the second 
school senesttr? 

*w Sttned vtry satisfied. j 

satisf 




Ir 


w«h better in reading . 


' - 46% 


b. 


socwhat better in reading. 




C. 


about the sane in reading. 


17% 


tf. 


soaevhat worse In reading. 


1% 


0. 


inch worse In reading. 


1* 


f. 


No Responso 





54% 



Sfied. 



b# Seeaed aort or lass 
e. Undecided. 

d. St toed nore or less dissatisfied 

e. Seeaed very dissatisfied. 

m £ . No Response 

Coe^aring this >ear to last year, ay 

child seeos to: 



«* be. very interested i n reading. 

b. be soaevhat interested in reading, 

. c. have about the saae interest i£* 
reading. 

d. be joeevhat less interested in 
reading. ^ 

• e. be v«ry unintorested in reading. 

* f . No Response 



m minoitM coxwzs you hay have uga&ug v;e stax koject?SuIv s ze itiiytuu 



child is doing: 

a. Mch better in school this, year 
than last year. 

b. aeaevhat better in scnool this year 
than last year. ^3% 

c. about the, S4r* in school this year 
than last year. ' 23% 

d. soaevhat vorse in school this year 
than last year. 

e. each vorse in school this year than 
last year. „ 1\ 

f No Response — 5T" 
X feel the STAR class is doing ti — — - 

»; . var* good Jotr in educating ity 

chlia. * 4gj 

b. food Job in educating ay child. 35% 

e. fair Job in educating »y child. 17% 
d. poor Job in educating ay child.* .1% 

v fIT J poor J ob ln Seating ay 7T~ 
™ ehird. * • 

rr 
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APPENDIX 1-4 (Cont^d) 
Non-Public Sch6ol Parent Responsw^Summary 



Dear Parent: - • N=229 

^ Uc arc currently developing plans for next year's Project STAr progran. You can help 
us In this planning by responding© the. questions appearing below. Your response to these 
questions should be based updn the Und of experiences your son or daughter has had, 1 
during the current school year. "Please ansver'the questions according to how you honestly * 
feel about then. , * 

WHEN YOU COMPLETE THIS Q'JESTIONNAI R£ HAVE YOUR SON OR DAUGHTER RETURN IT TO HIS 
OR HUR PROJECT STAR TEACHER. , 
J # Thank you^for your cooperation 



IIWICATE YOUZ ZZSPOUSE UY CTKCUW TWE LETTER UUTCH 
JttST ClOSEiy CO&ESrOMS TO YOUR HONEST F£Etf,VC) 

I. Has you child tatted to you 'about 
his/her STAR class this year? 



a. Yes 

b. Ho 



. How did your child seen to feel about 
his/her* STAR class during the first 
school semester? * * 

a. Secaed very satisfied. 

b. Seeoed core or less satisfied 
C. UmUcided. 

nora or loss dissatisfied. 

' a. Seesed vex/ dissatisfied, 
f. Ko Response 
, Hov did your child see* to feel about 
his/her STAR class during th* second 
school seaestqr? 

*» a. Seeoed very satisfied. 

b. Seeoed w or lass satisfied. 

c. Undecided. 

d. Seemed nora or loss dissatisfied. ' 

' a* Seee*d very dissatisfied. 

-< f . No Response, 
tceparing this year to last year, Vf 
child seeos to: 

- a* be very interested in reading. 

bo sooevhat interested in reading. 

have about the saae interest in 
reading* 



■ 8-Mi 

c. No Response iuv 



14% 
7% 




1% 



4% 



53% 
31%' 
9% 

s% 

2% 



3% 



36% 



b. 



43% 



14% 



■7. 



Coanailu-; this year to 'lost yoar.I fool 
Wf child is doing; 

a* such bettor in reading . 

b. socwhat better, in reading. 

c. about the saae in reading, 
et. acewt^st worse in reading! 4 
a. inch worse in reading. 

f . No Response 
Because of the STAR class I feel ,ny 
child is doing: \ 

a. Mich better in school this year 

.than last yoar. « 43% 

b. sosewbat batter in, scnool Xfrls yoar ' 
tnan last year. 41% 

V — — — 

c. about the same in school this year " * 
than last year. * 12% 

d. sooevhat worst in school this ye**^j ' 
than last yoar. '3% 

e. sveh worse in school this year than 
~ last year. f 
x. No Response 
I feel the STAR ^ lass is doing 



ver* good Job- in educatiar ay 
Chili. 



,4Q% f 



d. bo sooevhat" lass interested in 
reading. 

a* be very uninterested in reading, 
f. No Response 



3% 



1% 



b. 

c. 

d« 



f. 



jood job in educating a/ child. '34,% 

fair Job in educating ay child. 14% 
poor, job in educating ny child. 

very poor job in, educating ay 
child. 



m Moirtcuki co urns you hay have wgaxdm vti sm mjecr vbuu) ce ueutuU 



No Response 
va 




TV 
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'APPENDIX 1-5 



Survey -of Student Opinion* 

Block/Skills Reinforcement Classes 
N=248 



V 





Strongly 
Agree 


•Agree More 
Than Disagree 


I 

Not 
Sure 


Disagree More 
• Than Agre€ 


Strongly 
Disagree 


No 
Response 


1. I'm reading better this year 
than I did last year. 


43% 


36% 


12% 


5% 


- 

3% b. 
i 


„ 1% 


2. Being in a STAR class has 
helped me do better in my 
regular classes. 


29% 


31% 

i 


21V 


> 

10% 


8% 


1% 


3. ^Going to the STAR class 
, helped me learn to' read 
better. 


37% 


29% 


20% 


6% 


7% 


1% , 

> 


4 % I'm glad I f m in a STAR 
class. 

* * . 


, 21% 


23% ' 


23% 


12% 


20% 




5. I'd'Hke to be in a STAR 
class next year. 

« 


12% 


13% 


25% 


15% 


33% 


2% 


6. During the first semester 
of this, school year, -I 
liked going 'to my STAR class. 


*?4% 


28% 


20% 


13% 


11% 


4% * 


7. Students who aren't in the 
STAR classes wish that they 
were in them. 


10% 


13% 


39% 


16% 


20% 


2% 


8. I think the STAR classes 
should be in our school 
next year. 


29% 


. 18% 


27% . 


> 


15% 


1% 


9. The teacher in my STAR 
class did a good job in 
teaching me how to read. 


47% 


25% 


15% 


5% 






10*. During the "ascend semester 
of this school year, I liked 
going to my STAR class. 


\ 27% 


26% 


18% 


8% 


16% 


5% 



•Administered to students' in June, 1981. 



APPENDIX 1-5 (Cont'd) 

Survey of Student Opinion* 

Learning Center Classes 
N*338 



ITEM? 


Strongly 
Agree 


, Agree More 
Than Disagree 


Not 
SUre 


Disagree More 
Than Agree 


Strongly 
Disagree 


Response 


1. I'm reading better this year 
than I did last year. 


52% 


30% 


12% 


. 3% 


2% . 




2. Being' in a STAR class has 
helped me do better in my 
regular classes. 


30% 


t 

40% 

r 


17% 


6% 


7% 


— 


3. .Going to the STAR class 
, , helped me learn to readL 
better." * , 


41% 


34% ' 


15% 


, 6% 


3% 

- / 


1% 


4. Vm gilt I ( i in a STAR 1 
class. 


32% 


27% 


17% 


9% 


14% 4k 


IX 


5. Vd like to be in* STAR 
s class* next year.^ fc 




17% 


24% 


13*' * 


23% 


IX 


6. During the firs* Semester 
6f this school year, I 
liked" going to my STAR class. 


33% 


24% 


16% 


13* 


*11% 


3X . 


7. Students who aren't in the' 
STAR classes wish that they 
were in them. 


15% 


14% * 


40% 


11% 


19% ' 


, 1% 


8. I think the STAR classes 
should be in "our school 
next year. 


*41% 


26% 


18% 


5% . ' 


9% ; 


. 1% 


^9. The teacher in my STAR 
class did a good job in 
teaching. me how to read. 


61% 

' ■ a. 


21% 


9% 




''4% " 


' > \\ 


10. During the second semester 
of this school year, I liked 
going to ay, STAR class. 


ft 

34% 


28% - * 


14% 


8% < 


13% 


3** 



.♦Administered to students 



in June, 1981. 
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APPENDIX 1-5 (Cont'd) 

Survey of Student Opinion* 

Nonpublic School Classes 
N=45S 



* ITEM 


Strongly 
Agree 


Agree More 
Than Disagree 


Not 
Sure 


Disagree More 
Than Agree 


Strongly 
Disagree 


No 


1. 1 ! » reading better this year 
* than I did last year. 


49% 


35% 


11% 


2% 


2% 


1% 


2.* Being in a 'STAR class has 
helped me do better £n my 
regular classes. 


39% 


_ 28% 


21% 

K. 


> x > Z% 


4% 


1% 


3. Going to the^ STAR class 
helped me learn to read 
better. 

: ^ 


49% 


2S% 


14% 




4% 


1% 


4, I'm glad I'm in a STAR 
class. 

> 1 


49% 


21% 


11% 

z 


5% 


13% 


1% 


5, I'd like to be in a STAR 
class next year. 


42% 




-i 

18%) 


6% ■ 


20% 




w 

' 6. During the first semester 
of this school, year, I 
liked going to my STAR class. 


41% 


* 13% 


12% 


10% 


13% 


' 1% 


7. Students who aren't in the 
- STAR classes wish that* they. 
were 7 in them,. 


32% 


J 

14% 


> 

31% 


7% 


15% 




8. I'think theTVrAR classes 
^ should be in our school 
next yea^r. 


58% 


19% 


10% 




8% 


1% 


9. The teacher in my STAR 
class did a good job in 
teaching me how to read. 


63% 


19% 


7% 


3% 


• 7%; 
. 


1% 


10. During the aasiffld semester 
of this school /ear, I liked 
'going to my STAR class. . 
"< ^ ' : L 


47%^) 


23% 


12% 


5% 


10% 1 


A— 

3% 



♦Administered to students in May, 1981. 
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\ PUPIL ADJUSTMENT PROJECT 
1980-81 Title I Evaluation 



J. 



PURPOSE AND OVERVIEW 

The purpose of PAP (Pupil, Adjustment Project) is to develop basic 
social and academic skills among kindergarten pupils exhibiting special needs 
(but pot identified as LD or EMR) . PAP features supplementary instruction 
based^qn pupils 1 unique needs and learning styles, interdisciplinary support-' 
ive services, and specialized staff development. The highly individualized 
, instructional model involves extensive diagnosis and strong emphasis on lan- 
guage development, supplementing regular half-day^kindergarten provided under 
the 'school system's general fund. 4 * 

PAP services are provided- in three formats/intensities.^ Children 
enrolled in a Comprehensive Center class of 10-12 children are transported 
from and to home daily; thfey spend the entire school day at^this Center.. 
Other children are transported from their home-schools to one of the Adjust- 
ment Centers where, in a group of 10-15 children from several schools, they 
receive approximately two hours of supplementary instruction in the morning 
or afternoon; they spend the remainder of the day with their home-school 
kindergarten class (of 32 children, on the average). Still other children 
are served at their home schools by a PAP Traveling Teacher, who works_ with 
them<-individually or in a small group--on a rt pull out M basis, for about an 
hour three times a week. , 



SERVICE NUMMARY 

Pupils Served ' 181, 



Grade Served: 



Schools ': '47 ^- ( Staffing : 



7 



t 

Kdg. 



public 
(See Appendix A.), 



1 Consultant Teacher: 
Project Manager, FT 

2 Psychologist*, PT< 

2 Speech Therapists, FT 



Total Title I Expenditures : . $624 , 613 



Years in Operation : 13 

1 Social Worker, FT 
12 Teachers--7 FT, 5 PT* 
11 Educational Aides, FT 

1 Clerk, FT 
,6 Drivers--5 FT, 1 PT 

Per Pupil Qost : $3,45i*' 



SUMMARY OF FINDINGS 



During 1980-81 ,^the PupiJ Adjustment Project successfully completed 
its thirteenth y£ar in operation. Children's gains in language skills were 
greater than predicted. The some was true only for Comprehensive Center pupil 
in mathematics. 1 Teachers 1 pre-post ratings of children's social competency re 
fleeted growth^at expected levels in all*areas: self-sufficiency, emotional 
maturity, social skills and self-concept. 



* The f>er-pupil cost represents only Title rexftenditures; which were in 
addition to general fund support . . i 
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OBJECTIVES AND OUTCOMES ' • 

- r »• 

. Process Objective 1 : For the self-contained Comprehensive Centers, 
placement of the majority of 4-to-6-year-old children will be made on, 
or before November 1, 1980, but placement may' occur later as children 
are identified and space is available. • 

Outcome : This objective was attained., P.roject N records submitted to 
the evaluator indicated that 59 (90.8%) of 65 phildren served at Com- 
prehensive Centers were enrolled by November 1,^1980, 'as proposed. 

. Process Objective 2 : Eligible children will be admitted to Adjustment 
Centers, or assigned to a Traveling Teacher at any time during the year, 
as special identification procedures are completed and need arises. 

. Outcome : This objective was attained. Project records submitted to 
the evaluator reflected admission Qf children to Adjustment Centers 
from November through May and assignment of pupils to Traveling 
Teachers from November through April. 

. ^Process Objective 3 : Criteria for accepting pupils from regular Early' - 
Childhood Education classes into Adjustment Centers iand for returning 
these same children to their respective regular classes- -developed and 
piloted during the 1978-79 school year--will^be "re-evaliiated. 

. Outcome : Literally, tftis objective *as not attained (although the 
intended goal was reached) . 

• > 

. The "criteria, 11 strictly speaking, for any PAP placement are estab- 
lished according to Title I regulations and so stated in the pro- 
posal. Beyond >these g^nerat requirements for eligibility, the pro- 
spective PAP child exhibits One or more of the following: lags in 
perceptual-motor development ; slanguage delays/communications prob- * 
lems; social/eipotiona^ immaturity; poor comprehension; retention 
problems Referrals to PAP are most frequently iriitiated^by the 
child's (pre-kind&rgarten) teacher. Placement priority is offered 
to children exhibiting the greatest n^ed. t * ^ 

. The procedures for referral of a child to PAP have been refined and 
clearly specified. Parents and all selwol personnel involved with 
the child (teacher, principal, nurse, sdcial worker, speech 
therapist, psychologist) provided inpyt, on the'basis of which, these 
school personnel, as a t^am, formulated the recommendation shared 
with the child's parents. Placement recommendations -were made on 
the basis of each child's need (but were affected by the realities 
of geography, available space, transportation and parental consent ) . 

. The referral procedures (rather than established criteria) were 
re-eYaluafed or\ an ongoing basis by project staff and all others 
involved. 

/ 

. Teachers 1 records submitted to the evaluator indicated tfiat at 
least six Adjustment Center pupils were reassigned by team recom- 
mendation/parental decision during the school year — four to N 




. Process Objective 3 - (. continued) 

another Adjustment Center, one to a Compreheitsive Center and 
• another to regular kindergarten (with ongoing assistance from 

a Traveling Teacher) ^ 

• Pigcess Objective 4 : Project and regular classroom teachers will be 
involved i* planning ancf developing an instructional program which will 
• respond to the needs of children in the' following areas: 

V 

- communication skills adequate for listening tOv and expressing 
feelings, needs and ideas; 

- senstfry-motor skills for development of control of the body 
in the environment; 

- development of self-esteem and self-confidence through success- 
ful experiences; 

- sensory discrimination for development of awareness of and sensi- 
tivity to the environment, 

. Outcome : This objective was attained during 1980-81, The manager's 
reports and other project documents provided evidence that procedures 
were implemented to facilitate fortoal--as well as 'informal --contacts 
among project and regular teachers. ' r 

. Early in the school year, PAP staff made special efforts to insure 
that teachers receiving children who participated in PAP during 
1979-80 were appropriately informed/advised of each' child's needs. 
The manager reported that receiving teachers had indicated that 
having this information early in the school 1 year had been very 
helpful. 

» 

Regular teachers and other non-project school staff were involved 
on an ongoing basis with PAP Adjustment Center and Traveling 
Teachers, relevant to children's needs/progress and coordination 
of instruction. 

In November, February and May, arrangements for class coverage were 
J made so that regular kindergarten teachers could participate in 
« PAP Adjustment Center team meetings pertinent to their children. 

. Process Objective 5 : In addition to regular inservice meetings held 

by the Division of^Early Childhood Education, specialized staff devel- * 
opwent will be conducted in groups — and, as indicated* individually-- 
to facilitate attainment of* project goals. ^Sessions wild deal with 
such topics as: 

^ - individualizing the instructional plan based on assessed needs; 

- systematically observing and recording child behavior; 

* -199- 
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Process Objective 5 - (continued) 



- cognitive mapping; 

- developing curriculum appropriate to varied needs of pupils. 

. Outcome : This objective was attained during 1980-81. The manager's 
reports and other project documents provided evidence that the pro- 
posed specialized staff development was carried out in a variety of 
ways 

. Specialized inservice for, PAP staff was-^checjjiled into the Early 
Childhood Education orientation sessions held on September 17, 
18 and 19, 1980. Additional inservice meetings for PAP instruc- 
tional staff were held on October 24; February 13, May 7 and 21, 
and June 1. s 

The topics mentioned above were reemphasized through observation- ^ 
workshops (stuctured visitations to another PAP center) . Such a c 
workshop was provided for Comprehensive Center teachers on April 9, 
for Adjustment Center teachers on April 15 and for all project 
educational aides on April 30. 

. Throughout the year, individualized cm-site inservice was provided 
for PAP teachers by the project manager and Early Childhood Educa- 
tion teacher consultants. The number of consultant visits per 
teacher ranged from 2 to 13, with an average (median) %f 8.* w 

« « 

. Application of inservice "topics 11 to instruction of individual 
children was further promoted during team meetings (i . <e. , case 
conferences), discussed below in relation to Process Objective 7. 

Process Objective 6 : Special staff inservice will be conducted with the 
assistance of consultants from the University of Illinois relevant to 
utilization of PEEC (Precise Early Education for Children). 

- Selected staff will attend sessions at the University. 

- On-site staff development will be provided to PAP as a service 
of PEEC replication program .* 

- Techniques and findings will be shared in dissemination sessions 
with the total project staff. * 

. Outcome : This objective was not attained during 1980-81. It was not 
possible for PAP staff to travel to the University or for PEEC person- 
nel to provide inservice in cfevel'and this year. Staff did, however, 
continue to disseminate ideas and techniques developed by/with PEEC 
over the past several years. 

Process Objective 7 : Staff case conferences will be scheduled regularly 
to discuss selected children among instructional staff and representa- 
tives of supportive services—social work, special services (parent in- 
volvement), psychology, speech therapy;* nursing. 
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- Process Objective 7 (continued) 

* • " 

. - Outcome : This objective was attained. The manager's reports and 

other project records 'documented the regular scheduling of team 
* meetings, i_.e_. , case conferences. 

At Comprehensive Centers, initial team meetings to develop instruc- 
tional plans for each child were held on October 2, 3, 7 and 8, 1980, 
. Comparable meetings at Adjustment Centers took place the first week 
- of November, 1980, In late January and early February, team meetings 

at each center were devoted to establishing a current baseline read- 
^ ing cm the functioning of each child. At the May, 1981 series of 
meetings, team members reassessed each pupil's progress and formu- 
lated for each a placement recommendation for the fall of 198 1^ 

r 

. Process Objective 8 : Involvement 4 of parents with the learning experi- 
ences of their children will be continued through: 

- scheduling periodic parent-group meetings and parent educational 
* programs; * ' 

- dissemination of information through The Bridge (newsletter for 
parents of children in Early Childhood Edition) ; 

is r 

- encouragement of .parent conferences and meetings with staff; 

- promotion of parent visits to the Parent Resource Center as well 
as, the classroom; 

- integration of parents 1 opinions and suggestions into program 
— operations*, whenever possible, i ^ l 

. Outcome : This objective was attained. Project reports and other 
documents indicated extensive efforts to increase/improve parent 
involvement. 

The' project manager reported a total of 56 presentations to parent 
groups. These included an opening parent -meeting at each Comprehen- 
sive Centeij in mid-October and'at^each Adjustment Center early in 
November. PAP staff, along with other Early Childhood program per- 
sonnel, , provided several citywide parent-education programs, such 
as the following. - & - 

r , On November, 13, 1990, 127 Early Childhood parents (four with ^ 
children in PAP) representing 53 schools met to learn about the 

* projects and to plaft, parent programs for the year, 

. On January 29, 19^1, project parents were among participants in 
h N< an Early Childhood citywide program, "What [Cuyahoga County] 

Cooperative Extension Offers, 11 

, With Family Health Association personnel serving as leaders, 

♦ PAP parents participated in discussions of discipline : Love 
and Limits' 1 at a workshop held in their cluster (elementary and 

-201- , 

ERIC 206, . . ' " 



Process Objective 8 



(continued) 



secondary schools grouped for desegregation) during February, 1981. 
Seven such workshops were held, one in each cluster. 

. On April 8, 1981 t Miss Eamestine Simmons, Head of Children's Ser- 
vices, East Cleveland Public Library, was featured at the fifth 
annual Early Childhood parent reading readiness workshop held at 
the (Main) Cleveland Pttblic Library. Five project parents were 
among those learning "How to Help Your Child Bloom." 

In May, 1981 two workshops for parents, at schools, were held by 
the Cuyahoga County Cooperative Extension Service; some project 
parents learned more about feeding their families. 

Three issues of The Bridge (newsletter for parents of children in Early 
Childhood Education programs) were sent home with pupils--in January, 
March and Junejl981. Through words and pictures, parents were informe4 
about mattersfsu^h as : volunteering in the classroom; parent meetings- 
past and forthcoming's ervices provided by community agencies (TOT-LINE, 
TEL-MED, "Parenting Center at neighborhood branch of public library, etc.); 
promotion of children's learning through play, visits to parks, trips to 
museums; etc. 

Parents were encouraged to visit centers and meet with staff through- 
out the year, following the opening parent -meetings mentioned above. 
Supportive staff (speech therapists, psychologists, social worker) re- 
ported 1,505 parent conferences (mor^ than eight per child) plus 318 
home visits (averaging almost two per pupil). Although no count of 
parent visits to centers to observe was reported, by June 1 a total of 
*633 hours of assistance at PAP centers had been logged by 52 vplunteers. 
By June 12, teachers had conferred with the parent (s) of each PAP pupil 
about the recommenced fall-of-1981 placement and suggested summer acti- 
vities for parents to engage in with their children to promote learning. 

Parents were encouraged to borrow from one of two Sharing- -i^.£. , Parent 
Resource—Centers (at schools) materials for use with their children 
for home reinforcement of school learning. The Sharing Center located 
at a west-side school made available materials in Spanish as well as 
English. RecorAs of utilization/circulation were not, available. 

Parent input was welcomed by project staff at all times. It was more 
formally sought thrpugh the Project Priorities Committee (a PAP-£ocused 
subcommittee of the District Advisory Council) , three or four members 
of which met with the project manager on February 24 and April 1, 1981. 
PAP was represented in the District (formerly, Citywide Title I Parent) 
Advisory Council at meetings on November 18, January 12, February 17, 
March 9, April 6 and May 5. ' * 

Performance Objective 1 : Project children served for a period of, at 
least nine weeks will show a mean gain of at least four NCE units on the 
TOBE Language and Mathematics tests, administered on a pre-post -service 
*basis. < n 
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Performance Objective 1 - (continued) 



. Outcome : This objective was attained in Language projectwide and in 
Mathematics at Comprehensive Centers .only. 

Teachers administered and scored the pre-tests in early November and 
•the post -tests in mid-May. Raw scores were submitted to" the evaluator 
for conversion to NCE's (on the basis of the publisher's only norms-- 
November for Pre-K and K, used with pre- and post-scores; respectively) 
and analysis. 

Both pfre- and post-test results were available for 1 138 of the children 
served for at least nine weeks. For this total* group, the mean gain 
in Language was 12.4 NCE units, in Mathematics .9 NCE unit. 

Results were analyzed separately for pupils enrolled at Comprehensive 
Centers (N = 53), attending Adjustment Centers (N = 58) and served by 
<ar Traveling Teacher (N = 27) . Findings in tabular form have been in- 
cluded as Appendix B. * 

. At Comprehensive Centers, the mean gain in Language was 14.6 NCE 
units; in Mathematics, the mean gain was 7.3 NCE units. These re- 
flected movement from approximately* 34 *% r ile to 62 %-iie in Lan- 
guage,^! %-ile to 44 %-ile in Mathematics—based on the norms • 
mentioned above. 

. At Adjustment Centers, the mean' gain in Language was 13.3 NCE units - 
greater than in preceding years. (This may have been attributable 
to the fact that, during 1980-81, for the first time, Adjustment 
Center children were in school for the full-day--s^,nding the other 
* half -day with their home-school kindergartens.) This represented' 
movement from approximately 36 %-ile to 59 %-ile, based on the norms 
indicated above. The Adjustment children's mean pre-past scores in 
Mathematics reflected no change—approximately 48 %-ile -on -both pre- 
and post-test. 

i * 

f . Children served set least nine weeks by a Traveling Teacher showed a 
mean gain of 6.5 NCE units in Language, moving from approximately 
36 %-ile to 47 %-ile--based on the norms described earlier. Their 
relative standing in Mathematics declined from approximately 42 
%-ile to 27 %-ile. ^ 

Performance Objective 2 :. Project children at a Comprehensive Center will 
show a significantly (p<.05) higher level of social competency skills at 
the end of the year, based on teachers'- pre-post ratings on the Levine- 
Elzey Preschool Social Competency Scale. . _ 

. ' Outcome : This objective was clearly attained, at a, level of statis- 
tical significance (p<.001) exceeding that proposed. 

Comprehensive -Center teachers completed the Levine-Elzey for each 
pupil in early November and mid-May. These ^were submitted to the 
evaluator for calculation *bf mean ratings (maximum possible = 4) 



. Performance Objective 2 - (continued) 



v 

on each of four factors: self-sufficiency, emotional maturity, 
^ social skills and self-concept. Both pre- and post-ratings were 
'available for 59 children. . # 

Mean ratings on the four factors over the past three years have been 
included t^s Appendix C. Although the average gains in social skills 
and self-cdncept were slightly lower for 1980-81 than for the preced- 
ing two years, the objective was still attained. 

ADDITIONAL FINDINGS 

/ 

. Supportive Services : The scope of the supportive services provided for 
PAP. children far exceeded that reflected earlier in discussions of team - 
meetings and parent conferences, the importance of neither of which 
should be minimized. Beyond health and other supportive service pro- 
vided/obtained through general fund personnel, PAP children wer^e assisted 
by a full-time social worker, two full-time speech therapists, and two 
psychologists assigned half-time to PAP. 

. These project staff, collectively, averaged approximately 140 confer- 
ences per week with regular school staff and 9.4 agency contacts per 
week- -pertinent to PAP children. „ 



• All children in the project were screened for speech «nd/or hearing 
deficiencies. The speech therapists logged approximately 37 diagnos- 
tic testing/therapy sessions per week and, throughout the year, made 
' • about 25 referrals to A. G. Bell School for the Deaf or to community 

health resources. 

. The psychologists averaged 4.3 "formal assessments" and 7.4 classroom 
observations of children 'per week. ^ 
• > 

V • .The social worker logged an average of 35.7- clasSroom observations of 

children per week. ' . , 

Through cooperative efforts and multiple -contacts with regular school 
^ instructional and supportive staff, other project and Early Childhood 

* personnel, as well as community agencies, PAP supportive persorinel pro- 

vided extensive 'assistance in meeting the special needs of children 
enrolled in this project. 

• ' Fall, 1981 Placement : As noted .earlier, the instructional/supportive 
team for each PAP center (or child served by a Traveling Teacher) for- 
mulated a Fall, 1981 placement recommendation for each-child still en- 
rolled by June, 1981 (N = 172). 

. The recommended placement for^85 childrefn^ (49.4%) was first grade, a 
slightly larger percentage than the preceding yeaa/ (40.3%). Although 
70 of these children would not have been age-eligible to remain in 
PAP during 1981-82, the Metropolitan Readiness Tests Pre-reading 
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ADDITIONAL FINDINGS - (continued) 



Composite results indicated that they were ready for first grade. 
Scores available for 65 of these pupils yielded a mean raw score 
of 47.6, approximately 46 %-ile on national norms. 

. * Slightly Tnwfcr percentages than last year were recommended to re- 
main with PAP for another year (22.7%) or were referred to Special 
Education (25.0%). 

. Five children were recommended for regular kindergarten for 1981-82, 
as was one pupil the preceding year. 

• Metropolitan Readiness Tests : The Metropolitan Readiness Tests, Level 
II- (Form P) were administered citywide to all kindergarten children 
(including almost all PAP jDjapils) late in May, 1981. 

• 

. On the Pre-reading Composite Score for 80 (of the 85) PAP children 
recommended for first-grade placement in the fall of 1981, the mean 
raw'^core was 46.8 (approximately 44 %-ile) --almost identical to 
the 1979-80 mean of 46.4 (for 37 children recommended for grade one 
and tested). The 1980-81 citywide mean^scofce was not available as 
of this writing. 

r 

. On the Quantitative Skill Area Score for these same grpups of pupils 
•the 1980-81 mean raw score was 12.7 (approximately 37 %-il$), a 
slight increase over 11.6 (approximately 27 %-ile) for 1979-80. 
The 1980-81 citywide mean was not available as of this" writing- 

« 

CONCLUSION S 

^ 

The Pupil Adjustment Project completed its thirteenth year of suc- 
cessful operation during 1980-81. Six of eight Process objectives were at- 
tained, and these were the objectives most directly affecting services to 
' participating children and their families. , 

One performance objective was fully attained, the other partially. 
In the cognitive areas, PAP children's average, gain exceeded that proposed in 
Language and—at Comprehensive Centers only--in Mathematics. The average gain 
in Language for Adjustment Center children was almost as great as for Compre- 
hensive Center pupils, possibly; because Adjustment children remained in school 
for the full day this year. In tlte affective areas, gains^in all four factors 
of social competency were satistically significant at levels exceeding that 
proposed. m * * 

On the basis fcf the findings reported above and observations of pro- 
( ject operations over the years, it is recommended that: 

. , the process objectives for PAP be simplified and restated in more 
measurable terms; 

the Metropolitan Readiness Tests, Level I be piloted as a pre-test--to 
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CONCLUSIONS - (continued) 

be utilized with results of the MRT, LeveL II administered citywide as 
the post-test--for^assessing children's gains in cognitive areas; 

. possible- reasons for absence of gains in quantitative areas except at 
Comprehensive Centers be explored; * _ 

advantages and disadvantages of full -day Comprehensive Center service, 
as compared to half-day Adjustment Center plus half-day regular kinder- 
garten service, be investigated further in relation to both educational 
and cost effectiveness. 

A 
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APPENDIX A 



PUPIL ADJUSTMENT- PROJECT 
Schools Served 1980-1981 



Alfred A. Benesch 
Anthony Wayne 
Artton Grdina 
Benjamin Franklin 
Bolton t 

Buckeye-Woodland 
^Capt. Arthur Roth 
'Case 

Chafes H. Lal^e (C*) 
Charles Orr 

Chesterfield 
Clark 1 
Colrlett 

Daniel E. Morgan 
Denison 

Dike 

East Clark 

East Madison 

Geo. W. Carver (C;A*) 

Giddings 

Harvey Rice • 
Hazel dell 1 
Iowa-Maple (A) 
Kenneth W. Clement 
Kentucky 



Louis Pasteur v 
Margaret A. Ireland (A) 
Marion-Sterling 
Mary B. Martin 
Mary M.' Bethune 

Miles Standish 
Mount Auburn 
Mount Pleasant 
Orchard (A) 
Paul L. Dunbar (C> 

Paul Revere (A) 
Robert Fulton 
Scranton 
Stephen E. Howe 
Tremont 

Union (C) ^ 
Wade Park 

Walton (C) * 

Watterson-Lake 

Waverly 

Willow • 
Woodland Hills 



/ 



-/ 




* C = Comprehensive Center; A =■ Adjustment Center 
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APPENDIX B 
PUPIL ADJUSTMENT PROJECT: 4980-1981 
PRE-POST RESULTS:' TOBE LANGUAGE/MATHEMATICS 



n - ' - 



LANGUAGE * 

Comprehensive 
Qenters 



PRE-TESt* 

Mean Approx. 
NCE • %-jle 



53 42.1 



' POST-TEST* 

Mean Approx. 
NCE %-ile 



34 



56.7 • 162 



MEAN 
NCE 

CHANGE 



+14.6*-* 



Adjustment 
Centers* 



58 42.6 



36 



55.9 



59 



+13-^ 



» Traveling \ 
Teachers* * 



J*se» 

MATHEMATICS 

Comprehensive 
Centers 



27 42.3 



53 39.9 



36 



31 



48.8 



47.2 



47 



44 



+> 6.5 



+ 7.3**- 



Adjustment 
Centers* 



58 49.1 



48 



48.7 



48 



,- .4 



Traveling 
Teachers* 



27 45.9 



42 \37.1 



27 



3.8 



ERIC 



♦National norms were utilized: Pre-K for pre-tests and K for post-tests. 

^ **The proposed mean gain (at X.ea^t 4 NCE's) was attained. 

fResults were analyzed only for children enrolled fpr at, least nine weeks 
(Performance Objective 1) . f 
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APPENDIX C 
PUPIL. ADJUSTMENT PROJECT: 197'8-198l\ 



COMPREHENSIVE CENTER 
PRE-POST RESULTS: LEYJNE-ELZEY .PRESCHOOL' SOCIAL COMPETENCY SCALE 



FACTOR 



N 



PRE- 
Mean SD 



* POST- MEAN 
Mean SD . GAIN 



SIGNIF.. 

Level 



Self-Sufficiencv fl31 ' 





1980-8L> 


9 


2.17 


.,63 




"1979-80 


43 


2.01 


f ' 
.57 




1978-79 


47 


2.13 


.70 



63 3.01 



.59 


+ 


.84 


12,42 


P<. 


001 


.51 


+ 


.94 


. 9.47 


P<- 


001 


.55 


+ 


.85' 


6.41 


~P<- 


001 



Emotional Maturity O) 
1980-81 
1979-80 
1978-79 



59 2.33 
43 2.11 



.67 


3.13 


.57 


+ 


.80 


11.42 


p<.001 


^4 


2.97 


.52 


+ 


.86, 


9.45 


p<.001 


.86 


3.17 

S 


.54 


+ 


.79 


5.22- 


.P<001 



Social Skills (101 
1980-81 
1^79-80-— 
' 197&-79 



Self-concept d) 



59 2.32 .59 • 3.09 
J3 1.93 ;58 3.02 
47 '2.19^ .73 3.24 











.58 


+ .7? 


tl.35 


p<001 


.63 


+ 1.09 


11.36 


p<001 


.49 


+ 1.05 


8.01 


p<:001 



1980-81 


59 


2.24 


.70 


2.83 


.65 


+ .59 


" 31 


p<.001 


1979-80 


43 


2.14 


.67 


2.91 


.56 


+ .77 


7.01 


p<001 


1978-79/ 


47 


2.04 


.81 


2.80 


.65 


+ .76 


4.88 


p<.001 



erJq 



•Number in parentheses^, indicates the number o£ items scored in the factor. 
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t IMPROVEMENT PROJECT 



r 



Prepared by 

- Thomas Anderson 

0£elia Halasa 
Projept Evaluators 



Typed by 
Mary E, Logan 



Margaret Fleming ^ 
\, . Deputy Superintendent 



1980-1981 



215 



. READING IMPROVEMENT PROJECT 
1980-84 Title I Evaluation 



PURPOSE AND OVERVIEW 



The Reading Improvement Program is one of two instructional 
strategies of the Reading Instruction Project for pupils with reading 
problems. The. Reading Improvement Program component ppovides individual- 
ized instruction to primary pupils (Grades 1-3) v who are functioning at 
>the 33rd percentile or, below on stajndardized'tests of Reading or Readi- 
ness. Program instruction supplemeijf^ regular reading instruction with 
program services. provided to small group of 6 or less for 45 minutes daily 
in the school reading centfer. Individualized program instruction is 
supplemented by the following: coordination of "program instruction* with 
those of the regular classroom teacher and related reading programs /e.g. 
DPPF .Reading Impact Program), supportive work with parents and diagnosis 
of pupils 1 reading weaknesses and strengths. - Each Reading Instruction 
consultant serves approximately seven groups representing a maximum 
total ot 42 students per day. 



0 



SERVICE SU MMARY 

— ^— — > 

yPupils Served : 2,615 

^ Schools : 51 Public 

__7 Nonpublic 
'58 Total 

(For complete' listing 
see Appendix) 



Grades Served : 1-3 • Years in Operation r 15.5 

Staffing : 1 Educational Program Manager, P.T. 

3 Assistant Program Managers, F.T. 
49 Consultant Teachers, F.T. 
V ' 1 Clerk, F.T. 

2 Teacher Assistants, F.T. 



Total Title I Expenditures : $1,645,630 Per Pupil Cost* $629 



SdSlM^ 



.Y OF FINDINGS 



<0 



The Reading Improvement * Project was .effective in helping pupils " 
with reading problems at grades 1-3. Product objectives were attained. " 
Program participants at grades 2-3 exceeded the pre-post criterion gain 
of four NCE units on CTBS, Reading Vocabulary and Comprehension subtests. 
Participants at these grades demonstrated growth beyond expectancy -over 
time as initial reading performance (15th - 20th percentile ranks) Improved 
(24th - ^2nd percentile ranks). First grade participants were functioning 
at 41-46 NCE unitSrat year end.^ Reports of school staff and parents indicated 
favorable opinions about the project, and regular classroom teachers con- 
sistently rated highly the usefulness of its service information. Despite 
the observed improved reading performance of participants and positive re- ' 
ports, pupil performance continues to' fall below expectancy, indicative 
- of the need for continuing participation in this program. * 
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OBJECTIVES'AND OUTCOMES 



4' ^ 



Objective 1 : The reading skills of participating pupils (Grades 2- ~ 
3) will improve as evidenced by an increase of four NCE units in , 
mean scores based on pre-post performance of participants on 
standardized reading tests. . f 

Outcome: Objective 1 was attained . -Pre-post ^performance of 5 
' sample of Grade 2 (N=103) and Grade 3 (N=155) participants, re- 
vealed a significant gain (p <.001), ^exceeding the criterion Qf 
4 NCE units on CTBS Vocabulary and Comprehensive subtests (Table t) 



TABLE 1 



PRE-POST MEAN NCE SCORES ON CTBS READING 



CTBS 
Reading 

" ) 



Grade 2 



Pre-* Post* Gain t 



Grade 3 



Pre-* Post*> Gain t 



Vo&abu lar^ 



29.50 39.62 10.12 7.08+ 
(17) (32) 



Comprehend 
sion 



28.75—^.12 8.37 4.10+ 

(16) fee) 



31.91 
(20) 

28.19 
(15) 



37.08 
(27) 

35^38 
' (24) 



5.17 4.02+ 



.7.19 5#1+ 



* No. inside parenthesis under the mean scores represent correspond- 
ing percentile ranks , 

+ P<-001 , - _s 

For Grade 2, participants , observed pre-post gains for Reading " 
Vocabulary and Comprehension subtests were estimated to be at 
10.12 and 8.37 NCE units. Observed pre-post gain for G rade 3 
participants (for the same measures were slightly lower: 5; 17 and 
7.12 NCE units for Reading Vocabulary and Comprehension Subtests. 

Mkrked improvement in reading performance of program participants 
were eviderft when pre-post performance was compared to the norm 
group. Level of function at entr>$ at the 15th to the tOth per- 
centile improved over time as performance at 24th to 37th per- m 
centile was noted at the end of the school'year. 
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Performance of a sample of Grade 1 participants on CTBS 
Reading (C) Letter Sounds, Word Recognition 1, Comprehensive 
Passages, and Word Recognition II, indicated average mean 
NCE scores of 41-46. Table 2, presents the observed mean score(s) 
with associated standard deviation (s.d.) score and related 
percentile ranks. 



TABLE 2 

* i 

mean Scores in nce units of first grade participants by subtest 



CTBS Reading Subtest 


N 


Mean 


s.d. 


Percen- 
tile Rank 


Range in 
NCE units 


Letter Sounds \ 


73* 


40.67 


19.52 


31 

-J 

39 


1-68 • 


Word Recognition \ 


. 72 


44.39 


17.84 


1-80 


Comprehension Passages 


6S 


43.65 " 


17.38 


- . 39 


1-81 


Word Recognition II 


66 


46.09 


16.20 


42 


7-81 



Objective 2 : Classroom teachers will report observable improve- 
ment in the reading performance of 50% of a sample of participants. 

*# 

. Outcome : Objective 2 was attained. Questionnaire responses 
of 84 classroom teachers indicated that almost all of the 
participants demonstrated observable improvement in reading 
performance: 

- 97% improved in group work 

- *74% completed reading assignments 

- 88% showed more independence . in reading study skills 

- 96% showed more confidence in his ability to read 

- • - 70% demonstrated the ability to handle reading 

materials for his/her grade level 50% of the time. 
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furthermore, approximately 50% - 68% of the sample were 
reportedly functioning at middle-fifth (top 3/5) of the class 
or better in specific reading skills appropriate for their 
grade level, based. on ratings of classroom teachers (Table 3). 



TABLE 3 



PERCENT DISTRIBUTION OF PARTICIPANTS FUNCTIONING 



Reading Skill* 



Class Rank 



Top 60% 



Lower 40% 



Recognizing consonant/ sounds 


50% 


.• 50% 


Recognizing vowel sounds 


, 58% 


42% 


Identifying Sight words 


50% 


- 50%" 


Pronouncing words at grade level 


54% 


- 46% 


Finding main ideas 


53% 


«47% 


Following sequence 


68% 


32% 


Understanding of words from context 


60% 


40% 


Recognizing stated details 


66% 


34% 


Drawing Conclusions 


68% 


32% 



Objective 3 : Fifty percent of classroom teachers will provide 
a positive rating of usefulness of the project Service Information 
designed to maintain/cfceate communication between the regular 
classroom teachers and project reading consultants. 

* Outcome ; Objective 3 was attained. 1 Approximately 94% of 84 
classroom teacher respondents rated the Service Information 
provided by this project to be useful or better on a five- 
point rating scale of degree of usefulness. Majority of re- 
spondents called for the continuity and maintenance of this 
valuable service, with a few teachers calling for provision 
of more conferences and more classroom observations of con- 
sultants. Per cent distribution of teacher responses are noted 
in the following page. 
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N 


% 


27 


52 


44 


52 


9 


12 


2 


2 


2 


2 



Rating 

Extremely Useful. 
Very Useful 
Useful 

Somewhat Useful 
Of Little Use 



Objective 4 ; Fifty percent of parents will report through 
responses to; the parent opznionnaire that they have actively, 
supported their child's involvement with the J prc?ject through 
project-instituted activities such as individual conferences. 

• Outcome : Objective 4 was attained. Questionnaire responses 

of 69 parent respondents indicated that over 50% supported 
. children's involvement with the program as noted below: 

Approximately 57% (N-39J had talked with the project 
* teacher -consultant and a comparable 58% (N=40) talked 

N with the classroom teacher about reading skills of* 
their children. However, only 38% (N=26) had actually 
observed their child in his/her classroom during 'the 
school year, with number of observations ranging from 
one to three. 

1 Approximately 75% (N=52) reported that the project has 
been very helpful i^ improving 'reading skills of parti- s 
cipants. T 

Approximately 87% (N=60) reported that their children 
were reading more book£ at home while 61% (N=42) reported 
that thefr children (youngsters) borrowed more books- from 
* the library this ye&r. . ^^—^ 

Information ^regarding the program participation of 
children came from a variety of sources: 



) 



Letters ' '46% 

' Children 36.% 
* Teacher's Calls 12% 
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ADDITIONAL FINDINGS 



Principals 1 CN=25) impressions about the program effect on 
participants were very positive. Overall rating Of'program 
effect on participants in, the following areas was estimated 
at 4.00, based on a five point scale (5 as Extensive Impact 
to 1 as Minimum Impact) : 

- improvement in pupil activity 4.12 

- improvement in pupil workjiabits 3.89 

- parent involvement^ 3.24 

- team work among teachers 4.23 

v 

- improvement in pupil school attitudes 4* 



00 



School staff including school principals and regular class- 
room teachers pointed out that the individualized instruction 
and the resulting improved coordination efforts o£ project 
consultant and regular classroom teachers represented the « 
two outstanding benefits from Reading Improvement Program. 

Analysis of pre-post test performance of participants 

at Grades 2-3 revealed marked variability in change scores 

for Vocabulary and Comprehension subtests, 

- At Grade 2, Vocabulary change scores ranged from 

61 to -21 NCE units. Mean Vocabulary gain was estimated at 
10.12 with a standard deviation of 14.51.; Comprehension 
gains ranged from 53 to -44 NCE units. Mean comprehension 
gain was estimated at 8.37 NCE units with a standard 
deviation of 20.5. 

- At Grade 3, Vocabulary change scores ranged from 

55 to -35 NCE units. Mean Vocabulary gaiit* was estimated 
at 5.17 with a standard deviation of- 15. 20. Comprehension 
gain scores were equally variable, as they, ranged from 64 
to -36 NCE units. Mean Comprehension gain was estimated 
at 7.20 with a standard deviation of 17.13 : . 

Degrees of association between pre and post performance on Vocabu- 
lary and Comprehension subtests were low at each grade level. Simi- 
larly correlations between change scores of Reading Vocabulary and 
Comprehension subtests were low. 



221 . 



-218- 



CONCLUSIONS 



The 1980-1981 Reading Improvement Program was successful 
based on attainment of its four objectives. Coordination of project^ 
efforts with classroom teachers and witli staff of other similarYeading 
projects is worthy of note and should be continued . The observed 8-10 
NCE gains of participants at Grades 2-3, present reading status of Grade 1 *' 
participants and other reported positive findings frf>m the school staff and 
parents reflect the effectiveness of Reading Improvement Program in help- 
ing primary pupils with reading difficulties. 

Based on questionnaire responses and other objective data, the 
following recommendations are suggested for the future: 

1. Evaluation of pupil reading performance must consider other 
variables such a§ duration of project participation, attendance, 
consultant, etc. Global assessment" or project participants 1 
performance without considering these variables seems incom- 
plete. 

2. Classroom observation of consultants should be re-instituted 
to determine if differences in delivery of services (if any) 
have afty* measurable-*impact on performance. The marked varia r ■ 
bility of performance and gains raises questions as to whether 
this is a function of project effect, initial reading dif- 
ferences, consultant effect, etc. that needs further investi- . 
gation. 

3. Parent involvement efforts should be continued and strengthened. 

4. Classroom teachers 1 recommendation for creation of opportuni- 
ties to observe the consultants 1 teaching techniques, and for 
more interaction between classroom teachers and project con- 
sultants should be considered. 



222 



"APPENDIX . ' J 

READING IMPROVEMENT PROJECT 1980-81 



1. 


Alfred A. Benesch 


32. 


,Miles Park 


2. 


Almira 


33. 


Miles Standish 


'3. 


Anton Grdina 


34. 


Mo^es Cleave land 


' '4. 


Bolton ( 


35. 


Mound 


5. 


Brooklawn *^ 


36. 


Mt. Auburn 


6. 


Buckeye-Wood land 


37. 


Paul Dunbar 


7. 


Captain A. Roth 


38. 


Riverside 


8. 


Case 


39. 


Robert Fulton 


- 9. 


Charles Dickens 15 


40. 


R. 'G." Jones 


10. 


Charles H. Lake 


'41. 


Marion Seltzer 


11. 


Charles Orr 


42. 


Scranton 


12. 


Chesterfield 


43. 


Tremont 


*13. 


Corlett 


44. 


Valley View 


14. 


Denis on 


45., 


Verda Brobst 


15. 


Dike 


46. 


Wade Park 


16. 


Douglas MacArthur 


47. 


Waver ly 


17. 


East Clark 


48. 


William C. Bryant 


18. 


East Madison 


49. 


William R. Harper 
Willow \ 


19. 


Euclid Park 


50. 


20. 


Giddings r 


51. 


Woodland Hills 


21. 


Harvey Rice 




/ 


22. 


% Hazeldell 


NON- 


PUBLIC ; 


23. 


Henry W. Longfellow 






24". 


Iowa-Maple 


1. 


Our Lady /of Peace 


25. 


John W. Raper , 


2. 


St. Aloysius 


26. 


Joseph .Landis 


3. 


St . ' Cattjierine 


27. 


Kenneth Clement 


4. 


\ St. Joseph Collinwood 
St. Josfeph Franciscan 


•28. 


Louis Agassiz 


■ 5. 


29. 


Louis Pasteur 


6. 


St. Stanislaus 


30. 


Marion-Sterling 


7. 


Urban Community 


31. 


Miles 







Z23 
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READING STRATEGY PROJECT 



^4 



Prepared by 

S. James Zafirau 
and 

Gwendolyn Morton-Watts 
Project Evaluators, 



\ ■ 



Typed by 
Phyllis Carter 



Margaret FleUfkig 
Deputy Superintendent 
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READING STRATEGY PROJECT 
(98O' Title I Evaluation 



PURPOSE AND OVERVIEW 

Jhe Reading Strategy Project is designed to assist upper elemen- 
tary pupils in the mastery of basic . reading skills. This service is for 
students who nee4 correction. Supportive . teachers, working daily with small 
groups within the regular classroom, implement and extend the skill instruc- 
tion initiated by the classroom teacher. 



SERVICE SUMMARY 
Pupils Served : 



5,880 public 

396 non-public 
6,276 total 



Schools : 



Grades Served : * 4-6 public 



51 public 

10 non-public 

61 total 



(List of schools 
Appendix A) 



in 



Total Title I Expendit 



Staffing : 



tjres :. 



4-8 non-public m 



Years in Operation : 



1 Project Manager, FT 
1 Assistant Project Manager, 
9 Consultant Teachers, FT 
88 Reading Strategy Teachers, 



PT 



FT 



$2,339,434 



PT 



Psychologist, 
Clerks, FT 

Parent Education Counselor, 
Educational Aide 
Staff Aide 

Per Pupil Cost ; $373 



FT 



Ik 

( 



■ SUMMARY OF FINDINGS 



ERIC 



On a program wide basis (grades 4 to $) the available data showed 
that the Title I treatment group of students enhanced their* average reading 
comprehension score significantly more than would have been expected under 
non-Title I treatment, and that this, gain exceeded the project objective. 
However, th^re remain questions to be answered- concerning: A. the advisability 
of having two distinct and alternate criteria for program admission, B. the large 
number of pupil s^-whose 'scores were either not available or necessarily excluded 
from these analyses, and C. the question of what effect the above have on 
generalizing the 'data based conclusions to the program as a whole. Randomly 
selected participating pupils showed significant improvement in two out of 
five reading attitude subscales. Eighty-three percent (133 of 161) of the 
teachers responding to a survey reported changes haH occurred in their 
instructional procedures*thrdugh the use of the Reading Strategy diagnostic 
prescriptive approach. Ninety- two percent of a 239 parent sample which 
was surveyed Reported satisfaction with their child's reading improvement. 
Recommendations include changes in the program selection criterion, an 
addition of a comparison group for assessment of attitude change, a re- 
examing of policies which result in unanticipated outcomes consequent to 
soje program emphasis on reading comprehension, and continuing reassessment 
of the relative effectiveness of the Multi-Modality component when compared 
tp the regular Reading Strategy program. 
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OBJECTIVES AND OUTCOMES 

* . Process Objective 1 ; The Reading Strategy Project will be implemented 

in public and non-public Title I elementary schools serving pupils 
with greatest need, * 

. s Outcome : This objective was achieved. Fifty public-and ten non- 
public schpols were selected for Reading Strategy services based 
on greatest need. All but one of the Cleveland City Schools 
elemqitary schools met the poverty index criterion for JL980-81, 
arid so a^i of these 'qualifying schools were included i]L the pro- 
ject. The 10 non-public schools were those which met Title I 
criteria* and in which the principal requested ^he program. 

. Process Objective 2 : . Nine Reading Consultants wirl fee assigned to 
- N public and non- public schools, each one to serve a cluster of schools, 

toy^sist Reading .Strategy Teachers and Parents. 

. Outcome : This objective was largely achieved. • Seven Reading Conr 
suTtanFs were assigned to public schools and one. to non-public 
schools. * The assignment of schools to consultant's was based on the 
total number of schools to be served, the total njimber of teachers 
to 4 be served, the number of new teachers, the distance to be 
traveled, and so forth. The eight consultants assisted * Reading 
Strategy Teachers (materials, supplies, teaching techniques; etc.) 
and gave assistance in making arrangements for consultation serviced 
- to parents, ? as well as participated in parent programs when requested. 

f . Process Objective 3 : Pupils with reading deficiencies in upper 

4 elementary grades will be identified by use of program selection 

criteria. «• 

. Outcome : This objective was achieved. City-wide test data was 

used to identify those students scoring at or below the thirty- s 
third percentile on either thejCTBS or SDRT. In' some ca$es, court 
ordered racial balance requijea that, some students be placed in 
Titie^I^pa?0grams-^Ao achieved above thirty- third percentile on the 
pre-test. k Howeve^y^ the stu c^ntfl placed for racial balance were 
not included, in the data analysers. / 

. Process Objective 4 : A diagnostic - prescriptive plan will be 
generated- for each pupil eligible for service. 

. Outcome: This objective was achieved. Each identified-partici- 
pant's results of all subtests in the SDRT were 'reviewed. A plan 
was generated for eadh pupil on their need(s) from each subtest of 
the SDRT. In addition to the SDRT subtests, a pretest and item 
analysis from the Diagnostic Reading Probes are used to plan les- 
sons for pupils in grades 4, 5. Pretest^ from t the Curriculum for 
Improving Student Study Skills (CISSS) and item analysis aremsed 
to plan lessons for pupils v inlfrade 6. For each student, as a 
result, an individual reading Strategy plan was devised and each 
pupil was reinforced in comprehension as well as the other sfreas of 
identified student weakness. 
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Product Objective 1 : Participatihg pupils in grades four, five, and 
six will evidence an average post treatment score that is at least 
four NCE units above expectancy. Data<for each grade will be based, 
on regression analyses of the Comprehensive Tests of Basic Skills 
(CTBS) comprehension section, Test 1 a<£ninistere4 in AprJJ of 1980* 
and Test 2 in April df 1981. <, - 

* • — 

. Outcome : Objective 1 was obtained; 6r?a progTam-wid^ basis, tliis 
objective was obtained. However, there were distinct differences 



between grades. 



To- assess progress toward the attainment of the objective, the*- 
test performance of students served by the project was compared* * 
with an estimate of what their test performance would have been 
if they had not participated. This "expected" level of perfor- 
mance was obtained by Conducting a regression analysis on the 
test scores of a comparison group of students who scored above 
42 NCE units on the CTBS pre-test who were not served by the pro- 
. ject, and Reading Strategy^students wlto scored less than 42 NCE~ 
units on the pre-test. This analysis made it possible to predict. 
Reading Strategy students 1 performance on the Sa'rang, 1981 
administration of the CTBS from their performailtW on the Spring, 

1980 administration of CTBS. * Their actual scores onUhe Spring, 

1981 CTBS were then compared witji their expected scores to deter- 
mine if participation in the project had raised^their performance 
above the level that would" h^ve been expected , if they had not, „ 
participated. 

Grade- 4 



Matched scores {NCE units) available a for a sample^pf grade four,, 
participants in The Title I Reading Strategy project and a com-/ 
parison group (using CTBS Spring, 1980/cfBS Spring, 1981) yielded 
the following data. 



* Grade 4 
1980 - 1$81 



Mean Score (ACE) 
Test 1 Test 2 
Group >"N CTBS-80* CTBS-81** 

Served 1077 29.67 - 31.96 

Comparison 2685 58.20 51.73 

♦Level 1, Form S, administered in grade 3. 
**Level 2, Form S, administered in grade 4. 
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The application of regression analysis (Model C) to these data 
gave the following results in NCE units fbr the served group. 



Grande 


Predicted Y 


Observed X 


Effect of Total 
Program t_ N 


N With Min. 
Gain of 4 NCE 


4 


27. OS 


31.96 


+4.91 1D.81** 1077 


535 


**p < 


.01 









The results show that the participants scored significantly 
higher than it was predicted they would have scored without 
participation in the project. The difference of 4.91 NCE units 
between the observed and pr^^cted scores exceeded the criterion 
set in the objective. Since a positive difference of at least 4 
NCE units was obtained, the objective was attained at grade 4. 
(See Appendix B, for state-form-based summary of grade 4 regress- 
ion analysis.) < / 

Outcome : Grade 5 

Matched scores (NCE units) available .for a sample of grade five 
participants in the Title I Reading 'Strategy project and a com- 
parison group (using CTBS/CJBS) yielded the following data. 

1 



I Grade 5 

. 1980 - 1981 





•Mean Scor* (NCE) 




Test 1 . Test 2* 


Group 


N CTBS-80* CTBS-81** 


Served 


1100 28.26 34.22 


Comparison 


2371 56.99 W.44 


* Level 2, 


Form S,. administered in "grade 4. 


**LeveI 2, 


Form T, administered in grade 5. 







228 

-226- 



/••: 

The application of regression analysis (Model C) to these data 

gave the following results in NCE units for the served group! [ 

/ 



J ' _ _ Effect of Total N With Min. 

Grade Predicted X Observed X Program t N Gain of 4 NCE 




5 ^28.13 34.22 +6.09 13.70** 1100 '614 

**p 4. .01 ^ 

/ 

The results show that the participants scored significantly higher 
than it was predicted they would have scored without participation 
in the project. The difference of 6.09 NCE units between the 
observed and the predicted score exceeded the criterion set by the 
objective. Since a difference of at least 4 NCE units was obtained, 
the objective was attained at grade S. (See Appendix B, for a state- 
form-based summary of grade 5 regression analysis.) 

C " • 

A Reading Strategy subcomponent of pultiple teaching/ learning 
modules existed in the Title I Reading Strategy program at grade 5 
only. Matched scores (NCE units) available for thes© Multi-Modality 
participants and a comparison group yielded the fallowing data. 



Multi-Modality 
(Existed Only in Grade S) 

1980 - 1981 



Group 
Served 
Comparison 



Mean Score (NCE) 
Test 1 Test 2 . 

N CTBS-80* CTBS-81** 



89 28.33 
2371 56.99 



♦Level 2, Form S, administered in grade 
**Level 2, Form T, administered in grade 5) 




The application of regression analysis (Model C) to these data 
gave the following results in NCE units for the served group. 







Effect 'of 




Total 


N With Min. 


Grade, Predicted X 


Observed X 


Program 


t 


N 


Gain of 4 NCE 


. S 28.19 


32.65. 


+4.46, 


2.70** 


89 


« 44 


(Multi-Modality) * 




%> 







**p < . 01 



The results show that the participants scored significantly higher 
than it was predicted they would have scored without participation 
in the project. The difference of 4.46 NCE units between the 
observed and the predicted scor* exceeded the criterion set by the 
objective. Since a difference of at least 4 NCE units was obtained, 
the objective was attained for the Title I Multi-Modality group. 
However, when these results are compared with those for the regular 
Title I program fdr grade 5, it is apparent that the regular Title I 
students do better than the Multi-Modality students by more than an 
extra one third of the average NCE gain score (4.46 compared to 6.09, 
for a net difference «1.63 NCE in t^vor of the re^ilar Title I 
students). 

Outcome : Grade 6 , - ^ 

Matched scores (NCE units) available for a sample of grade six 
participants in the Title I Reading Strategy project, and a com- 
parison group (using CTBS/CTBS) yielded the following data. 



^ Grails 6 

1980 - 19^1 





r- 




Mean Score 
Test 1 


(NCE) 
Test 2 




Group 


N 


•CTBS-80* 


CTBS-81** 




Served 


447 


27.73 


•3S.3& 


V 


Comparison 


2443 


54.15 


55.08 



♦Level 2, Form T, administered in grade S, 
**Level 2, Form S, administered in grade 6. 



-228- 230 



\ 



The application of regression analysis (Model C) to these data 
gave £he following results in NCE units for the served group. 









r 




Effept of 


Total 


N With Min. 


Grade Predicted X Observed X 

* 


Program t^ 


N 


Gain of 4 NCE 


6 33.42 35.38 


+1.96 3.40** 


447 


195 



**p <.01 



The results show the participants scored significantly higher than 
it was predicted they would have scored without participation in . 
the project. However, the difference of 1.96 NCE units between 
the observed and predicted scores did not meet the criterion set 
by the objective. Since, a positive difference of at least 4 NCE 
units was not achieved, the objective was not considered attained 
at grade 6. (S.ee Appendix B, page 15 *for a state -form -based 
summary of grade 6 regression analysis.) 

« 

• - Product Objective 2 : Randomly selected participating pupils in 
identified grades will demonstrate significantly improved attitudes 
towards reading, as reflected in the comparison of mean pre/post 
test responses on a locally constructed Pupil Attitu4e Survey. 

. Outcome : Objective 2 was, probably attained in part. An estab- 
lished instrument for measuring reading attitude^* 'A Survey of 
Reading Attitude? f , by Walbrown, Brown and Engin,%977) was 
adapted to meet local' program needs (See Appendix C). This 
condensed and adapted attitude scale is comprised of 35 Likert- 
type attitude items which can be summated into total and five 
(factor analysis based) subscale scores. 
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A randomly selected group of^-participating pupils in grades 4-6 
were administered this attitude scale "both at the beginning apd 
at the end of the' 1980-81 school year. The total attitude scale 
score did not yield a significant difference from pre-test to 
post -t est. fHowever, the factor analysis based subscales clearly 
indicate change. ^ * 

Each item in each subscale, as well as in tR^ total scale of 
reading attitude, was converted so that the least positive » 
attitude response on a five point scale had a value of one and 
the most positive attitude response had a value of -five. .For 
each pupil, the values of all individual item responses were*' 
averaged for each subscale arid for the total scaled to give 
individual subscale and total scale scores in terms of this 
same one to five scale score range. Pre- and'post-test scores 
for each of the subscales as well as the total are presented 
in the following table. 

\ 



' -229- 

<» . 23 J 



k 




• "Reading Attitude Scores 
1980-81 



; > Scale/Subscale 


Pre- 


Test 


Post 


-Test 


t-value 




Mean 


s.d. 


Mean 


s.d. 




Reading Anxiety 


3.40 


.85 


3.57 


.88 


2.69* 


Expressed Reading Difficulty 


3.10 


1.02 


3.28 


1.07 


2.43** 


Reading As Direct Reinforce- 
ment . 


3.97 


.85' 


3.80 


.95 


-2 . 54** 


Reading as Enjoyment 


3.44 


.97 


3.21 


1.04 


-3.29* 


Reading^ Group * 


4.20 


.75 


4.05 


.85 


-2.77* 


Total Scale 


3.60 


.60 


3.56 


.67 


.68 



**»*p < . 01 
**p < .05 . 

Significant improvements (p<£'.05) in both Reading Anxiety and 
Expressed Reading Difficulty subscales' occurred between pre- and 
post-te>ts. It might reasonably be argued that these are direct 
. positive program effects. Increased comfort with reading seems - 
to have occurred. c 

•Each of the three remaining 0 subscales (Reading as Direct Rein- 
forcement, Reading as Enjoyment ^^and the ResCUpg Group Subscales) 
indicate a significant attitude change in a negative direction. 
This might be attributable as much to the second semester, end- 
of-year 'blues 1 as anything else.^ Fall to" late spring attitudes 
typically decline. However, it could fce argued that it is- 
shakey to attribute one set of changes but not the other to "the 
treatment. * 

) • 
. * It would be desirable if a 1 comparison group of otherwise com- ' * 

parable non-Title I pupils could take this attitude scale, also. 

Comparing the- post-test attitude scores of the comparison group 

with those of the* Title I treatment group (while computationally 

controlling for the effects of differing pre-test scores, if that 

is the case) wduld assist .-in more confidently concluding whether 

* * the changes in treatment group attitudes are due to the unique 

program treatment or are simply due to, the passage of the school 

year, or other such extraneous causes • \ 



Product Objective 3 ; As evidenced by their opinionnaire responses, 
teachers will become sensitized to instructional techniques utiliz- 
ing the diagnostic-prescriptive approach. 

. Outcome : Objective 3 was considered attained. In June, 1981, 
a survey was distributed to teachers whose classrooms were served 
by the project. Eighty-three percent of the classroom teachers 
(N=161) responding to the survey reported the use of the diagnostic 
prescriptive approach was effective to very effective, as evidenced 
by: 

. improved diagnosis of students individual needs 
for instruction of specific reading skills. 

. increased flexibility in grouping of students for 
reading skills reinforcement. 

* improved selection of pupils for the reading skills 
reinforcement. 

(See Appendix D for. the summary of Classroom Teachers Survey.) 

Product Objective 4 : Eighty percent of the parents of the project 
participants will report satisfactory feelings about their child 1 s 
reading improvement. 

. Outcome : Objective 4 was attained. In June, 1981, surveys were 
sent to parents of project participants in 37 schools. Ninety-two 
perfient of the sampled parents (N=239) reported satisfaction with 
their child's reading improvement. 

v 

(See Appendix E for summary of Parents Survey.) 



ADDITIONAL FINDINGS 



There were several noteworthy additional findings regarding 
objective 1, which pertain to program success as measured by standardized 
reading ttest scores. First, Model C (regression model) results wfere com- 
pared to results obtained using Model A (pre- flr post-test t-test model). 
Both analyses used the same restricted Model C group of students, and both 
used the normal curve equivalent (NCE) measuring unit as the unit of 
analysis. Model A yielded a slightly lower average CTBS Comprehension 
'score gain for the project than did Model C. (See Appendix B for 
statistical detail). Second, the criterion for admitting students into 
the Title I Reading Strategy program was that each admitted pupil's pre- 
test score be at or below the 33rd percentile on either the Stanford Diag- 
nostic Reading Test or the Comprehensive Test of Basic Skills. This proce- 
dure was the major factor causing nearly one-fourth of all Tittle I CTBS pre- 
test scores to be above the 33rd percentile (See Appendix G for greater 
statistical detailj! IKlrd, the same Model C regression analysis done using 
the CTBS vocabulary subtest yielded very different results than it did with 
the CTBS comprehension subtest scores. (See Appendix B for greater statisti- 
cal detail). For the 1980-81 program year, Model A yields much more favor- 
able results than Model C when the vocabulary subtest is the unit of analysis 
A somewhat more thorough and technical presentation of these three additional 
findings is contained in Appendix I, as well as in Appendices B and G. 

A survey was sent to principals (See Appendix F)..*ho had the Read- 
ing Strategy program in their schools. Of the thirty-five who responded, 
97 percent said that the Reading Strategy program contributed to meeting 
the reading needs of the participating students. Ninety- four percent of 
these principals responded that this program was either effective or very 
effective in improving reading skills of the participating students. r 

A series of fourteen inservice - staff development sessions or 
activities were held during the 1980-81 school year ffer the Reading Strategy 
project teachers and staff (See Appendix H). 

The Reading Strategy project director has presented other findings 
and assessments, including the following: 

. The CTBS test seems to give an inflated score, and so^fhe SDRT 
has been used as the second of these alternate selectors to 
give pupils an additional chance at meeting selection criteria 
and thereby receiving the service they need. 

f * 
The comprehension score is not uniformly^ reflective of program 
emphasis. For example*, in grade four and in the Multi-Modality 
component, there is a heavy emphasis on vocabulary. V, 

< ' ♦ * 

. Throughout the past several years involving court ordered \ *: 
desegregation, the Reading Strategy program has been subjected 
to numerous and unexpected staff changes, frequently result&g 
in personnel being 'placed into the Reading Strategy program 
regardless of the appropriateness of their previous assignments, 
expertise, or teaching performance record. . 

> 
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If there are a number of teacher absences in a given building, 
the Strategy teacher is pressed into service for the day. 

The reorganization of classes as late as November and December, 
which in recent years has become commonplace in the elementary 
schools, results in disruptive midyear rescheduling, with the 
attendant shifting, dropping and adding of pupils within Read- 
ing Strategy serviced classrooms. 



CONCLUSIONS 

On a program wide basis (grades 4 to 6) the available data 
showed that the Title I treatment group of Students enhanced their average 
CTBS comprehension NCE score significantly (p < .01) more than would have 
been expected under non-Title I treatment, and that this gain Exceeded the 
project objective of 4 NCE points. However, there remain questions to be 
answered concerning: A. the advisability of having two distinct and alter- * 
nate criteria for program admission, B. the large number of pupils whose 
scores were either not available or necessarily excluded from these 
analyses, and C. the question of what effect the above have on generaliz- 
ing the data based conclusions to the program as a whole. Randomly 
selected participating pupils showed significant improvement (p^<..05) 
in both Reading Anxiety and Expressed Reading Difficulty subsets between 
pre- and post-testing; while a significant attitude change in a negative 
, direction was found for the Reading as Direct Reinforcement, Reading as 
Enjoyment, and the Reading Group subscales. Eighty- three percent (133 of 
161) of the classroom teachers responding to 3 survey reported -changes had 
occurred in their instructional procedures through the use -of the Reading 
Strategy diagnostic - prescriptive^ approach. Ninety-two percent of a 239 
. parent sample which was surveyed reported satisfaction with their child's 
reading improvement. 

— Recommendations are as follows: 

. It is recommended that in the future one consistent measure or 
operational definition be used as the criterion for program , ^ 
qualification (such as one identical type of test score, or 
an average of two types of test scores for all Reading Strategy 
students), -if at all possible. 

. Seriously v consirfer excluding from admission into the Reading 
Strategy program- any student who has pre-tested out at above 
the 33rd percentile — * and more compellingly be excluded if 
pretesting out as 'above average 1 — on either of -.th^standardized 
reading comprehension tests lisea .(CT^S and SDRT)-. An illustra-* 
tion: If a student had a CTBS reading comprehension pretest 
score of 75 percentile and a SDRT reading comprehension score 
of 30 percentile, it is highly probable that the CTBS score is 
mpre reflective than the. SDRT of the pupil's real reading com- 
prehension achievement, which, is likely well above average. 
It iS much more likely that the pupil had an unreliable SDRT ' 
jesting than by chance alone gufessed his/her way to the lfiuch 
higher CTBS score. Having a significant number of treatment 
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pupils in the pre-test data base who have scores above the 
established cutpoint compromises the integrety of 'the related 
data analyses and the conclusions .dxaum-thsrefeoa. 



Attention should be given to the supplemental finding that 
Reading Strategy students score approximately as much lower 
than expected on the vocabulary subtest as they do higher than 
expected on the comprehension subtest when compared against 
the performance of non-treatment students at the same jjrade 
in the Cleveland Public Schools. It should be determined if 
the net reading achievement 'gain which remains after this s 
apparent (time-on-task based) tr^de-off is the maximum possible 
jfith the available resources. It should be determined if there 
is a significant net gain, qualitatively speaking. Efforts 
should be made to determine how the gains in comprehension can 
be retained or even enhanced while concurrently preserving the j 
-average vocabulary score-based percentile rank. These inter- ^- 
related issues need to be examined in depth, followed by related 
plans and subsequent action. 

With the Multi-Modality component showing a satisfactory but 
less dramatic increase in average CTBS comprehension NCE gain 
that the regular Title I program did during its first year, 
continuing assessment of the relative effectiveness of this 
component when compared to the regular Reading Strategy program 
should be done. 

A comparison group for the attitude survey would be highly 
desirable in order to sort out unique program effect from 
ordinary fall to -spring attitudes changes. Refinement of the 
existing attitude scale, including setting it in larger type 
.and revising several items to refer specifically to the Reading 
Strategy program, would be desirable. 
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APPENDIX A 
READING STRATEGY 
ELIGIBLE TITLE I ELEMENTARY SCHOOLS 
1980-81 School Year 



1 


* 

Public 


* 


\ 


1 

X • 


A* • J • K1CKOXX 


36. 


Nathaniel Hawthorne 


2. 


Anthony Wayne 


37. 


Oliver H. Perry 


z7 


Art emus Ward 


38* 


Orchard ' ■ 


4. 


Benjamin Franklin 


39.) 


Paul Revere 


5. 


\*rooklawn 


40/ 


Robert Fulton 


A 
v . 


DUilTcr m \ 


A 1 

41. 


Stephen c. Howe 


v 7.. 


Case 


42. 


Sunbeam - 


1 8. 


Charles Lake 


43. 


Tremont 


9. 


Chesterfield 


44. 


Union 


10. 


Clark 

• 


45. 


Verda Brobst " 


11. 


Cranwpod 


46. 


Wade Park 


12. 


Daniel E., Morgan 


•47. 


< Walton 


13. 


East Madison 


48. 


Warner 


14. 


Emile B. deSauze ^ 


49. 


Watterson-Lake 


IS. 


Euclid Park 

\ 


• 50. 


William R. Harper 


16. 


Forest Hill Parkway 


51. 


. Willow 


17. 


Fullerton 






18. 


Garfield 








George W. Carver 




Non-Public 


20. 


Gordon 4 










1. 


Blessed Sacrament 


91 


urac emoun l 


2. 


Holy Name/ 


22. 


H. W. Longfellow 


: " 3. 


Holy Rosary 0 


23. 


Halle 


4. 


Lutheran Memorial 


'24. 


Kenneth Clement 


5. 


Mt. Pleasant Catholic 


25. 


Kentucky 


• 








6. • 


Our Lady of Peace - 


26. 


Lafayette 


7. 


St, Paul Croatian 


27. 


Margaret Ireland 


' 8. 


St. Rocco 


28. 


Marion Sterling 


— 9. 


St.- Jimothy 


29. 


Mary B. Martin • 


10. 


Urban Community 


30. 


Mary Bethune 






31. 


Memphis 




* 


32. 


McKinley 






33. 


Miles Park 




v 


34. 


Milford 






35. 


Mt. Pleasaitt 
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Comparison of Reading Comprehension Achievement Results in the 
1980-81 Title I Reading Strategy Project Using Title I Evaluation 
Models A and C on Indentical Data Sets 



Model A 
If Pre- Post Norm Referenced! 



Grade 



N 



BPretest 
*CE X* 



Post Test 
NCE X* 



T NCE 
Diffe- 
rence 



— Model C 
(Special Regress ion} 



Expedted 
Post 
test ^ 
NCE X 



Observed 
Post test 
NCE X* 



X NCE 
Diffe- 
rence 



Number Who Gain- 
ed +7 (+4) NCE 
pts. or More 



Comparison Gi^oup Based 
Regression Line 



Pre/ Post x 
fwith N) 



Slope 



* Y Inter- 



ce 



?pt 



4 iin 

5 1100 

6 447 
All 



to 
w 



Grades 



2624 



29.67 
28.26 
27.73 

28.75 



31.96 
34.22 
35.38 

33.49 



+2. 29 
+5.96 
+7.65 

4.74 



27.05 
28.13 
33.42 

28.59 



31.96 
34.22 
35.38 

33.49 



+4.91 
+6.09 
+1.96 



4.90 



455 (535) 

518 (614) 

145 (195), 

1118 (1344) 



.50 (2478) 
.50 (2250) 
.50 (2345) 



.88454 
.92598 
.74268 



.80478' 
1.96342 
12.82754 



Number of Participants Omitted from Growth Data Because of: 

. Missing pretest or post test (Includes entire group of 396 nonpublic students} 

. Insufficient time in project 
• . Pretest score used for regression was above 42 NCE 
Total Number of Participants Omitted from growth Data ** ' 



979 
1836 
, 837 
3552 



q *The nationally norraed NCE scoring units for the Comprehensive Test of Basic Skills were used. ' ooQ 
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Comparison of Reading Vocabulary Achievement Results in the 
1980-81 Title I Reading Strategy Project Using Title I Evaluation 
Models A and C on Indentical Data Sets 



Grade 



N 



Pretest 



Model A 
(Pre-Post Norm Referenced) 

^ NCE 



Post Test 
NCE X* 



Diffe- 
rence 



Model C 
fSpecial Regression) 



Expected 
Post 
test 
NCE X 



Observed 
Post test 
nCe 5(* 



r NCE 
Diffe- 
rence 



Number Who Gain- 
ed +7 (+4) NCE 
pts. or More 



Comparison* Group Based 
Regression Line 



Pre/Posj: x 
(with N) 



Slope 



Y Inter- 
cept 



5 
All 

Grades 



914 
796 
430 

2156 



30.03 
30.40 
'29.05 

29.75 



tf7.36 
32.91 
34.69 

34.91 



+7.33 
+2.51 
+5.64 

+5.16 



38.58 
36.26 
42.86 

38.29 



37.36 



32.91 ' 



34.69 



34.91 



-1.22 

-3.35' 

-8.17 



•3.38 



467 (548) 

270 (463) 

214 (277) 

951 (1288) 



.43 (2436) 
.53 (2601) 
.45 (2034) 



.67148 
.85428 
.62329 



18.40942 
2.36491 
21.52155 



I 

t 



dumber of Participants Omitted from Growth Data Because of: * 

. Missing pretest or post test (Includes entire group of 396 nonpublic students) 934 

. Insufficient time in project 1836 

. Pretest * score used for regression was above 42 NCE ' 1350 

Total Number of Participants Omitted from growth Data " 4120 
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' *The nationally normed NCE scoring units for the Comprehensive- Test of Basic Skills were used. 
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APPENDIX C ^ 

Condensed, Revised and Adapted Version of 
A SURVEY OF READING ATTITUDES 
f Intermediate Level: Form A 

.(Third Experimental Edition, 1577) 
<^ by, 

Vallbrovn, Brotm and fcngin 

~ DO NOT MATE ANY, ((ARCS ON THIS SIDE OR THE RACK 

UNTIL THE DIRECTIONS ARE COMPLETED 

DIRECTIONS 

St 

Fill in your naae in the spaces provided below. Do not make any 
Barks in the box below Jt. Your teacher will complete ti*e items in the box. 
Now we will read the directions alopd for you. 

The statements in this booklet are concerned with the way you feel, 
about reading. There are no right or wrong answtrs because students have 
different opinions and feelings about their school work. For example, if I 



amy "Reading is more fun than math. 



Vn sure the students in this room would 



mot all agree. Some people would disagree because they enjoy math more than 
reading. Probably somev^ther students would not be sure about how to answer 
because they like both reading and math. So, you can see thert are no right 
or wrong answers. The important thing is to mark the answer thac shows how 
you really feel or what your opinion is. 

X will read each statement aloud while you read it silently from 
the page. After each statement has been read, you are to decide how you feel 
about it and then circle, the choice which tells how yeu feel. Circle A to show 
that you agree with a ^tateaent. Circle B if you areVot sure how you feel about 
a statement. Circle C to" show that you disagree with a statement. Do- not use* 
a pen. Use a soft-lead pencil (#2^ or less). Erase completely any answer you 
wish to change. 

Please be sure -that you mark the answers which show how you really - 
feel rather than the way I want you to mark them. The letters and what they 
stand for are written at tfce top of the question page (reverse side of this page) . 



LAST NAME 



(36-45) 



. FIRST N AME 

m 



M.I. 



STUDENT I.D. NO. 


0 | 0 

















PO NOT MARK IN BOX 1 BELOW 



RACE ■ SEX GRADE SCHOOL 



/ 

DATE ATTITUDE SURVEY GIVE*: 
STUDENT'S BIR7HDATE: 



P P Q 

(69). Tn) (731 



SCHOOL 













MONTH, ■ 



DAY YEAR. 



tl£2o) t2£23i T33T35!) 



1980- 81 TOTAL DAYS ABSENT (Excused and On excused) BY QUARTER: 



□ 



1ST (28-29) 



FALL 1980 SD NCE: 



SPRING 1980 CTBS NCE: 



2ND 



SRD 



4TO 



VOCABULARY 



COMPREHENSION 



(40-41) 



(43-44) 



■ (49-SO) 



SJ2 (l?/l/80) 
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A • * - not sure c - disagree 

* 

CAANPLE5 


Agree 


Not Sure 


Disagree 


a. Reading is more fun than math. 4r 


A 

A 


D 
D 


C 


b. I often read comic books. 


A 


B 


C 


N" ■ 

1. I need a lot^of help in reading. 


A 


B 


C 


2. r would like to help someone else who can't read »« w«ii ** t 


A 


B 


C 


-3. I get upset when I think about having to read. 


A 


B 


C 


4. I can read but I don't understand what I've t+iA 


A 


B 


C 


5. Most of the stories in our reading books are inrer*«rino 


A 


B 


C 


* 6. I am a slow reader. 


A 


B 


B 


7. I enjoy helping other students with their reading 


A 


B 


C 


S. When I am at hoae, I read a lot. * 


.A 


B 


C 


9. I often feel sick when I try to read a Ion a itt i vnnMt 


A 


B 


C 


10. learn lots of interesting things in our v+xAinm amim 


A 


B 


C 


11.. I enjoy looking up information in the ancvr lon^rfi* 


A 


B 


C 


12. When I have free time in class. I read a' hook 


A 


B 


C 


13* I get upset when we take a reading test. 


h 


6 


C 


14. I get a lot of eniovment from mv read in? 


A 


a 


C 


15. Our reading group is usually eniovahle 


A 


-L 


C 


16. No matter how hard I try. I -fust can'* him rk *m*A w »ti 


A 


B 


C 


17* f«t nervous when I have to read a lot. 


A 


B 


C 


18. When I read an interesting story T tikn to t»ii mv a* .Km** 4* 


A. 


B 


C 


19* My parents think I need to try to improve my reading. 


A 


B 


C 


20. Sometimes I miss a Question on a test because T read r*ooriv 


A 


B 


C 


21. My friends and I often discuss what we have read. 


A 


B 


C 


22. I enjoy telling my 'family about thV-tHints we r#ad in «chooi 


K 


B 


C 


25. Sometimes I have nightmares about reading. 


A 


B 


C 


24. I learn a lot in our reading group* 


A 


B 


c- 


25* I like to listen to other people tell about tha Hook* rh*v h*v* **mA 








26. I worry a lot about my reading. 


± 






27. Reading is one of the most interesting thinvs which i da at hnm* 


A 




c 


2$. I get a sick feeling in my stomach when I think about reading. 


A 


B 


c 


a 29. When I try to read T u«uallv rivmA *nA - 1 - 

* »» * **/ ww * ^ x *A3u*xxjf ^ c l tircu aim sxeepy. 


K 


B 


c 


30. Our reading group is one of the best parts of school. . * 


A 


B 


c 


31. I'm the kind of person who really enjoys a good book. 


A 


ft-. 




3£. The teacher has to help me a lot when we are in reading group. 


A 


B 


o 


33. I usually read several .books during summer vacation. 


A 


B 


c 


34. A book would make a good present for me. 


A 


B 


c 


35. I listen carefully when other students are telling about what they 


A 


B 


c 


, * have read, s 

r 

• ** 
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APPENDIX D 

READING STRATEGY 
1980-1981 

5SR00M TEACHER SURVEY 

Frequency and Percentage of Classroom Teacher Responses 
In Each Rating Category 
V, (N=161) 



1 



Selected students in your classroom have participated in the 
Reading Strategy fproject. We would like your*viewpoint of the 
services provided the students through the Reading Strategy 
project. 




Please circle the aftsWer you select. 



l.\^as the use of the diagnostic-prescriptive approach had any effect on 
your awareness of individual student's reading needs? This approach 
was 



Very 
Effective 

52 (32%) 
Comments : 



Effective-' Undecided 

i 

81 [51%) 20 (12%) 



Ineffective 
1 (.17%) 



Very 
Ineffective 

4 (2%); 

I 



No 

Response 
3 (2%) 



. Very helpful in diagnosing individual needs. 

♦ J>£Hdents became more interested in reading. 

. Discovered exactly where hfelp was needed. 

. The children perform better in reading due to the 
indiyidual attention. 

Excellent as a supplement to classroom instruction. 

« 

. The diagnostic-prescriptive approach assisted the 
teacher in planning and organizing skill groups. 

•. I have a better idea of what each chili can do. 

. Gave a specific area for indepth work needs. ^ 

. Provided guidelines for skill livel work. 

* 
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APPENDIX D (continued) 



Have you observed changesMn the Reading Strategy students reading 
habits? YES 117 (73%) NO 34 (21%) NO RESPONSE I'D (67%) 

f 

. .What did you observe: 

Students were willing and ready to do the skills. 

r 

The children utilized skills in their basal texts. 

Improved attitude and skills mastery. 

Students took more interests in reading assignments. 

Willingness to contribute in reacting group discussions, 
improved reading skills in both oral and independent 
work . ^ 

In your opinion, what is Reading Strategy's unique contribution to the 
student's progress in reading? 

. The student is made more aware of where his weak areas are in 
reading and is encouraged to improve. 

4* v 
. The students seems to enjoy reading "as they are applying- the skills 

. An increased awareness of the rules purpose of each skills. 

. The teacher (Reading Strategy) is able to work on a more individual 
basis. N " * 

. Reinforces skills which teacher has taught. 

. Reading Strategy brings the slower reader to a point so that he/she 
can benefit more from regular .classroom work in Language. 

. The opportunity to work in a small setting contributes to the stu- 
dents progress. , * 

. The unique worksheets games etc. for- follow up of skill lessons. 

If changes were implemented, what would you recommend? 

. Servicing a wider range of children with reading difficulty. 

. If present classroom number continue-Reading Strategy will have td 
be done in a separate room since the children are now wall to wall 
with -NO corner available. - • S 
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APPENDIX D (continued) 

See to it teachers have' reinforcement Worksheets of skills taught 
be the reading consultant, also a set of «mast<ers for the class- 
room teachers. ^ ' \ * / 

More time if possible. ^ 

Individualized instructions were \ery beneficial to students. 
Jhe one to one relationshi^te^ed to build confidence ana students 
performed better than they wouukhave io a large group settings. 

program is excellent. ^ 

Strategist should use another room available other than the class- 
room. 



2 4 V 



9 
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APPENDIX E 

READING STRATEGY ' 
1980-1981 

PARENT SURVEY 



Frequency and Percentage of Parent Responses 
In Each Rating Category 
(N*239) 



Your child has received reading 

help through the Reading Strategy project. Please tell us what you 
think about the Reading Strategy project. 



*Circle the answer you select. 

1. Are you satisfied with your child's reading improvement this school year? 

• YES 222 (92%J NO 13 (6%) NO RESPONSE 4 (2%) 

. How satisfied are you with your child's reading? 

' 69 (29%) 142 (59%) 16 (7%) 0_ 6 (2.5%) 6 (2.5%) 

Very Very No 

Satisfied Satisfied Undecided isfied Dissatisfied Response 
5 4 3 2,1 

Comments- about their child's reading improvement. 

. "She has improved greatly, still needs reading 
assistance. 11 

M . Belinda has really improved. I am very proud of her 
progress ." 

( 

~ . "I was satisfied because when shp started the program 

% she was a poor reader.**** 

. "She enjoys, reading and understands much better." 

. '"Yolaijda enjoyed the classes because the teacher pro- 
vided "individual/small group attention."* 

2. Would you like your child to continue in the Reading Strategy program? 
\^ YES 225 (94%) NO 10 (4%) NO RESPONSE 4 (2%) ^ 
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APPENDIX E (continued) 



Comments to why you would like your diildvto continue In Reading 
Strategy, 

* * ■ <■ 

• "Kelly is slow in reading* the reading strategy* project 
A has built his confidence, " 

* 

, Have^meetings at. the beginning of the year to explain 
goals the children hope to accomplish. Have other' 
.meetings to report progress, 

# • A guide for parents : to follo?f the reading skills for • 
mastery during the school year, m f. 

\ \ * 

Did you attend anjr of the Reading Strategy meetings held for parent 

this school year at your child's school? 

< 

YES 76 (32%) NO 163 (68%T V ■ - 

s . Tab lie « s 

* ' * Parent Attendance • • - 



y N , Times 'Attended 

„ 11 ■. - 2* .» 

59 l(at least) 

' * 5 

Replies to "how were the materials at parent meetings helpfu}?" 

, Presented ways to help your child e,g, 
f ' -reading newspaper and magazine ads/ 

-making the grocery list, 

-reinforcing lessons that are sent home. 

-making games that encourage reading to be fun. 

-providing a handbook for parents in reading skills. 



4 



It provided the materials and ideas for me to help my 
child at home. ^ 
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APPDENDIX E (continued) 



What 'reading information would you recommend bepresented at the 
parent meetings? 

. Continue to make available reading materials for home 
use e.g., v 

-Construction of reading games. 

-Circulation of pamphlet with activities for parents to 

help their child with reading skills. 

a * 

-Present ideas on how to use .magazines and newspapers, to 
reinforce reading at home. 

-Worksheets that can be studied by the child with the parent 



J 
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APPENDIX, F 

READING STRATEGY . > ■ 

1980-1981 

PRINCIPAL SURVEY 

Frequency and Percentage tff Principal Responses 
In Each Rating Category 
(N n 35) 



Selected students in your school have participated in tie Reading - Strat- 
egy program. We would appreciate your view poirit of the services pro- 
vided the students through Reading Strategy, * * 



*Circle the answer you select. 



l£ Does the Reading Strategy program contribute to meeting the reading needs 
of the participating students? 

' YE S 34(97%) N O 1 (3%) 

2. How effective is the Reading Strategy program in improving reading skills 
of the participating students? 

. v 

'18 (51%) 15 (43%) 1 (3%) m 1 (3%) - 0% 



Very * Very 

Effective Effective Undecided Ineffective Ineffective 

5 4 3 • 2 1 



Comments: 

- 

The program is effective when staffed with a competent strategist 

This is an extension of what the classroom teacher (does and what 
the* child needs. 

Teachers comments indicate that the program is effective. 
. Teachers specifically requested that the program remain the same- 
Small group instruction is the key. v 
Builds self-esteem through mastery. 



APPENDIX F (continued) 



If changes were implemented, what would you recommend?' 



Responses: 



Assignments of students based on teacher, judgement and test scores 

Selecting children who ne£d the service most, regardless of racial 
balance. 

s, 

Strategists be allowed to work with students outside- the' school's 
classroom (to provide student's greater concentration). 

Reassign effective strategist to the same building. 

Assign experienced teachers to the program, to warrant Ihe time 
the student is released for reinforcement. " 



4 
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Frequency Table of title I Reading Strategy Grade 4 
CTBS Reading Comprehension Pre-Test NCE Values 



NCE 




ADJ 


CUM ' 






An t 




NLfc 




ADJ 


CUM 


VALUE 


FREQ 


PPT 


PfT 


VAT IIP 
VALUE 




rLl 


PCI 


VALUE 


FREQ 

• 


PCT 


PCT 


1 


23 


1 


i 


40 


90 


6 


67 


55 


23 


1 


95 


7 


11 


1 


2 


41 


62 


4 


71 


56 


22 


1 


97 


13 


27 


2 


4 


43 


44 


3 


' 74 


■ 58 


6 


0 


97 


15 


41 


3 


6 


44 


50 


3 


77 


59. 


8 ' 


1 


98 


19 


52 


* 3 


10 


46 


39 


2 


79' 


61 


11 


1 


98 


22 


78 


5 


. 15 


47 


33 


2 


81 


63 


11 


1 


99 


25 


100 


6 


21 


48 


31 


2 


83 


66 


4 


0 


99 


27., 


107 


7 


23 


49 


.34 


v 2. 


85 


68 


4 


0 


1Q0 


30 


102 


6 


34 


50 


33 


2 


88 


71 


2 


0 


100 


32 


121 


8 


42 


51 


27. 


i 2 


89 


76 


2 


0 


100 


34 


- 106 


7 


49 


52 


25 


2 


91 


80 


1 • 


0 


100 


' 36 " 


103 


7 


55 


53 


22 


1 


92 


99 


2 


0 


100 


38 


89 


6 


61 


54 


25 


2 


94 
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Number (%) .of Title I Group Pre Test NCE Values Above 42: 459 (29.2%) ^"v 



MEAN NCE 
MODE 
KURTOSIS 
MINIMUM 



35.742 
32.000 
0.805 
1.000 



VALID CASES 1571 



STD. ERR. 
STD. DEV. 
SKEWNESS 
MAXIMUM 



0.318 
12.603 
N 0.078 
99.000 



MISSING,CASES 227 



MEDIAN 35.670 
VARIANCE- 158.827 
RANGE 98.000 
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- A < Frequency TaSfof Title I Reading^trategy'-Grate 
t Reading Comprehension Pf e-Test NCE Values • * 



NCE 
VALUE 



1 

7 

10 

13 

15 

19 

23. 

2*5 

-29 

32 

34 



FREQ 



'18 

19 * 

35 
. 58 

56 
« 87 
118 

sa 

139 



ADJ 
PCT 



CUM 
PCT 



1 

2 
4 
4 

6 ; 
8 

1 

7 

10 
9 
9 



1 
2 
5 

V 

18 
26 
33 
43 
53 
62 



NCE 
VALUE 



37 
40 

42- 



44 

46 

48 

49. 

51 

53 

54 

56 



FREQ 



136 
95 
60 



'45 
47 
40 
27 
24 
22' 
15 
9 



ADJ 
PCT 



9 
6 
4 



3 
3 
3 
2 
2 
1 
1 
1' 



CUM 
PCT 



8 / 



71 
78 
_82. 
81 
88 
91 
92 
94 
96 
97 
97 



NCE 
VALUE 



57 
59 
60 
62 
* 63 
64- 
66 
68 
70 
83 



FREQ 



11 
9 
6 
3 
4 
2 
2 

2 • 
1 
2 



ADJ 
PCT 



1 
1 
0 
0 
0 
0 
0 
0 
0 
0 



CUM 
PCT 



98 
99 
99 
99 
99 
100 
100 
100 
100 
100 



Number '(%) of Title J Reading Strategy Group Pretest NCE Values Above 42: 271 (18.3%) 



m 



x 
a 



o 
o 



MEAN NCE 
MODE- • 
KURTOSIS 
MINIMUM . 



32.142 
29.000' 
0.129 
1.000 



STO. ERR. 
STD. DEV. 
SKEWNESS 
MAXIMUM 



« 0.325 
12.504 
0.083 
83.000 



MEDIAN 32.218 
VARIANCE- 156.354 
RANGE 82.000 



VALID CASE'S' 1481. 



MISSING CASES 102 
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Frequency Tables of Title I Reading Strategy Grade 6 
CTBS Heading Comprehension .Pre-Ielt;_NC,E Values 



























NCE 




ADJ 


CUM 


NCE 




ADJ 


CUM 


NCE • 




ADJ 


CUM 


\t a t tin 
VALUE 


CD CA 

rRfcl} 


PCT 


PCT 


VALUE 


FREQ 


PCT 


PCT 


VALUE 


FREQ 


PCT 


PCT 


1 


11 


2 


2 


33 


* 

33 


5 


58 


51 


10 


2 


95 


7 


26 ' 


4 


6 


35 


44 


7 


65 


52* 


8 




96 




30 


5 


11 


38 


43 


7 


* 72 


54 


5 




97 


15 


28. 


5 


, 16 


40 


47 


8 


79 


55 


7 




98 


19 


27 


4 


' 20 


42 


19 


3 


83 


56 • 


4 


J 


99. 


22 


43 


' 7 


27 


44 


22. 


4 


86 


58 


' 7 




100 


oc 


'A X 


7 


1 A 

34 


A £. 

46 


18 


3 


89 


68 


1 


0 


1G0_ 


28 


54 


9 


43 ' 


47 




2 


92 


75 


1 


0 , 


. 100 


31 


57 

{ 


9 


52 


49 

r 


9 


1 


. 93 
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Number (%) of Title I Group Pre-Test NCE Values Above 42: 107 (17.5%) 



MEAN NCE •• 31.132 
MODE "» 31.000' 
KURT0SIS -0.203 
MINIMUM '1.000 



STD. ERR. 0.517 

STD. DEV. 12.783 

SKEWNESS ' -0.099 

MAXIMUM 75.000 



MEDIAN 31.272 
VARIANCE 163.410 
RANGE ' 74.000 



•VALID CASES 612 



MISSING CASES 51 



APPENDIX H I 
— READIUG-STRATEGY — - - 

Inservice - Staff Development 

1980 f 1981 



September 17, 18, 19 t 



Cluster Inservice* - Project'Staff • 



October 16 

November 3 
November 17 

December 18 
January 'll 

January j£l • 

January 27 

February 25 
February 27, 28, 29 
March *3 
March 16 
March 20 

A^ril 24 
May 19 



A.M. Non Public Teachers .in service. 
P.M. Modalities Center teachers in- 
service, v 



Inservice - New teachers \ 

Inservice* - Teacher^^ervicing #6 
"Curriculum for Improving Student 
Study Skill." ' * " 

Staff Development 'iMastery LeaAigg" 
Patricia* Bowman . . V 

■* 

"Evaluation, 1979-81 - Results §' In- 
terpretation." Gwendolyn WU*+»i»* 
Division of Research and D^Wlopmsnt 



In-Service, selected teachers - 
"Developing Reading Activities for 
Newspaper Publication" 

Staff Development "Black English/ 
Educational and Social Implication" 
Dr. Howard Mims, Cleveland State U. 



S 



Skills Share Fair % 
Inservice - New Teachers ' 
Cancelled 

'Inservice - Modalities Center Teachers 

Staff Development - (Staff and 10 pro- 
ject teachers). Schdols Vision Forum. 
Holiday Inn, Warrensvill Hts. 



Project Meeting 
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Staff Development - "Title I Projections 
for 1981-82" Dr. John P. Nairus. 
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ADDITIONAL FINDINGS SUPPLEMENT 

There were several noteworthy additional findings Tegarding 
objective one, which pertained to program success as measured by stand- 
ardized reading test scores. 

First, the data were reanalyzed using the Model A design instead 
of the Model C design, which was pre-selected and' used as the primary 
analytic method. For comparability with the Model C analysis treatment 
group, those Title I treatment group pupils scoring above 42 NCE on the 
pre-test were also excluded during the Model A based analysis. On a 
program-wide basis, using the CTBS comprehension subtest score and the 
same restricted set of students used with Model C (regression model), 
Model A (nationally normed NCE score based pre- to post-test t-test model) 
does ^iot- yield as great an NCE gain as Model C does. Model A yielded a 4.7 
NCE average gain; Model C yielded a 4.9 NCE average gain (See Appendix B for 
more data detail) . This Model A result^would be even less favorable (as 
well £S would the Model C result) if those "too high 11 (and thus excluded) 
protest score students had been included in the analysis. This is 
deducible both inferentially (regression towards the — treatment group — 
mean) and directly/ empirically from the collected test scores data. ^ 

Second, the criterion for admitting students into tK8 Title I i- 
Reading Strategy program is that each pupil score less than 33rd percen- 
tile (approximately equal to a 41 NCE) on either the Stanford Diagnostic 
Reading Test (SDRT) or the comprehensive Test of Basic Skills (CTBS). As a 
result of this procedure, many students who score above the 33rd percen- 
tile .on one test will score below on the other. Many students who score 
below the 33rd percentile on the CTBS will score noticeably above that on 
the SDRT. For many of these students, that CTBS score is not a typical 
performance, and'it can be expected that a retesting on that or equivalent 
form of the CTBS will result in a higher CTBS score.' Thus, many who score 
misleadingly low on one test will be included in Title I, and their inclusion 
consequently has to artificially inflate average end-of -treatment CTBS post- 
test score. Similarly, some may have scored higher on the CTBS than on the 
SDRT or could have bean-otherwise expected; due, perhaps, to such things as 
lucky guessing. Thus the average percentile rank of these types of CTBS 
pre-test scores can be expected to drift backwards (regress towards the v 
treatment group mean) if retested immediately or prior to treatment. Both 
of these two types of case's represent measurement errors which, if per 
vasive, can invalidate the data set and conclusions drawn from itr. ^iSince 
they act in opposite directions, their effect on related group statistics 
^night be partially or nearly cancelled out by the effects of tfce other. / 
Exactly to what extent is typically not directly determined. The cause of 
present concern is that: 

* . In Model C as contrasted to Model A, treatment group pre-test; 
scores above the pre-determined f cut f score are omitted from £he 
analyses, thus eliminating the possibility of the erroneously 
•too high 1 scores offsetting the erroneously 'too low 1 scores. 
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APPENDIX I (cont'd) 



. A very large percentage (24.2%) 6f all otherwise available scores $ 
grades 4-6, are lost from the Model C analyses. This is in addi- 
tion to scores lost for other reasons. ' 

. Of those Title I students who have CTBS pre-test scores above 33 
percentile, a surprisingly large number scored in the top two 
4 quartiles, with a couple of scores even being at the 99th percen- 

tile levelK (See. Appendix G for grade by grade 'normalized' per- 
centile score, i.e. NCE distributions)' ^~ , ~ 

Third, the same regression analysis done using the^CTBS vocabulary 
subtest yields- very different results than it doo*uising the comprehension 
subtest (See Appendix P). Although Reading Strategy students- compare 
favorably with the comparison group with respect to the comprehension score, 
this did not hold true with respect to the vocabulary score! This suggests 
a differing program emphasis, between Reading Strategy and comparison group 
students. If we were using the vocabulary score as the program criterion 
this year instead of the comprehension score, Model A would give us better 
results than Model C. 

This comparative result could (and probably would) vary from year 
to year. There are important differences between Model A and Model C and 
what they do — both in terms^ of analytic procedures and the constructs and 
criteria they assess. Model A compares the treatment- group to a national 
norm. Model C compares the treatment group to the non- treatment (comparison) 
group in the same school district . This has the effect (for Model C) of 
fairly validly determining whether the treatment group has done better, worse 
or tha same as it would have done had it been left in a non-treatment 
situation within the same school district. In general, if non-treatment 
group achievement history has shown that children in the school district 
typically slip in their nationally normed (NCE) percentile rank, Model C 
probably will yield more favorable and valid results for assessing, the 
•merit of the. treatment group's special program effect in the school district. 
However, if the educational dynamics of the system for a given year are 
such that the average non-treatment (comparison) group pupil enhances his/ 
her comparative nationally normed standing, assessment of the treatment 
group's^ special program effect would to that extent be more favorable if 
Mbdel A was used. 



RESIDENT TUTOR PROJECT 



1 



Prepared by 

Ronald Gerboc 
Project Evaluator 



Typed by 
Constance Brewton 



Margaret Fleming 
Deputy Superintendent 



1980-1981 



258 



RESIDENT TUTOR PROJECT 
1980-81 Title I Evaluation 



PURPOSE AND OVERVIEW 

The Resident Tutor Project offers Grade 1-8 students remedial 
reinforcement of specified reading and/or mathematics skills. Priority , 
service is given to those students who are eligible to participate in 
another Title I project, but who cannot be served, due to enrollment limita- 
tions. Pupils identified by classroom teachers as needing assistance and 
who meet prpject eligibility criteria are tutored* on a regular weekly 
schedule by a full-time educational aide (Resident Tutor) . Tutors assist 
students on an individual or small grouj) basis outside of the regular class- 
room for approximately thirty minutes per- day, up to five-days per week. All 
tutors receive orientation and ins^rvice training throughout the school year. 
Selected schools are also served by a Parent Resource Center established to 
provide a variety of tutoring activities than can be used at home, 

SERVICE SUMMARY 

Pupils Served: 1>16 Grades Served: 1-8 Years in Operation: 13 

Schools: 35 public Staffing : 

13 nonpublic 1 Project Manager, FT 48 Educational Aides, FT 
48 total 3 Consultant Teachers, FT 1 Clerk, FT 

(See list in Appendix A) 

Total Title I Expenditures: $470,090 Per Pupil Cost: . $S^5 

SUMMARY OF' FINDINGS ' 

In its 13th year of operation, project activities were directed by 
a newly appointed manager. Project consultants, who were responsibile for / 
developing monthly tutor training sessions, were required' to develop specific 
objectives and evaluation procedures for each session. A total of 15 Parent 
Resource Centers were in operation to provide parents with constructive ways 
of sup porti ng student skill development in the home. . " 

Project records indicated that approximately three of every four 
assignments completed by tutors were in the reading skill area. Project 
students demonstrated performance levels that easily exceeded the criteria 
prescribed in both the reading and mathematics objectives. Standardized 
reading test performance not only exceeded the criteria prescribed, but 
.demonstrated a noted improvement when comparisons were made with the previous 
year's results. n - 

/ * 
Data suggested that jareful planning should be accomplished to 
insure, that tutors are assigned* to schools with the greatest number of -eligible 
studen^ .efforts should be made to investigate the revision of the project's 
manual'lftd-' tests, policy' regarding the number of sessions offered to individual 
students should be\ reviewed, and continued emphasis should be placed on parent 
invqlvement^ * • ' 
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OBJECTIVES AND OUTCOMES 

NOTE : As a preface to this .review of project activities, the reader should be 
aware of various events which affected project operations during the 1980-1*1 
school year. * * 

. As requested by the Director of Government Programs • of the Catholic 
Diocese of Cleveland, permission was granted by the Division of 
Federal Assistance of Ohio's Department of Education to offer 
Resident tutor services to Grade 7 and 8 nonpublic schoo.l students* 
Two 6f the thirteen nonpublic schools obtaining project services irt 
19&D^81 extended service to students in Grades 7 and 8. 

. Due to the continued financial problems encountered by the Cleveland 
Public School System, 4 of the project's 48 educational aides- were 
either transferred to other non-Title I positions or were laid-off 
during December, 1980 and February, 1981. A restriction on hiring new 
personnel prevented project management from obtaining replacements for 
these' individuals. 

♦ 

. Desegregation implementation preparations necessitated the granting of 
an extension in the number of days all Cleveland Pujblic School employees 
' were to be in pay" status. Budgeted Title I monies- were insufficient to 
support project operations during this additional school time. Approval 
was granted by the Office of Urban Programs, State of Ohio, Department 
of Education to co-fund approximately 35 percent of Resident Tutor pro- 
ject operations from April £1, 1981 to June 30, 1981 through use of 
Disadvantaged 'Pupil Program Funds. * The instructional focus of the 
project as described in the 1980-81 proposal remained intact. 

The following presentation represents a composite of major findings ob- 
tained from an assessment of a variety of evaluation data. These findings have 
been organized according to the variqus process objectives (objectives which 
prescribed thte major operational tasks) and product objectives (objectives m 
which specified observable changes in student knowledge) guiding project 
activities during the 1980-81 funding year. 

, Process Objective #1: Forty-eight full-time educational aides and up to 
10 part-time college students will be hired as tutors to be assigned to 
up to 48 public and 20 nonpublic .title I elementary schools, 

• 4 

Outcomes: This objective was partially attained. With the initiation 
of the school year in September., 1980, a full complement of educational 
aides (48) were assigned to 35 public and 13 noitpublic participating 
project schools. ( Note: Due to reductions in 1980-81 Title I funding, 
the total number of school's served by thf. project declined by 35 
percent from the previous funding year - from 73 to 48 schools) All 
aides with the exception of one assigned to nonpublic school duties 
served 1980-81 participating Schools on a full-tpTe^-f ive day schedule. 
Budget limitations necessitated assigning this nonpublic aide to 
part-time (of ha^lf-day) tutorial duties in two schools. As previously 
noted, an unexpected extension in the 1980-81 school, year mandated 
that further reductions be made in project services. The subsequent 
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transfer and lay-off of aides during December of 1980 and February o£r^ 
1981 caused tutorial services to be discontinued in four project 
schools. Beginning March 16, 1981/ fou£ project aides who had pre- 
viously begen servicing one school* on a full-time basis were asked to 
divide their time between two schools (i.e., two days per week in a 
school affected by project aide cutbacks and three days per week in 
their original jjfcchool assignment).^ In effect^, 'from March 16,. 1981 to 
the close of the' school year (June 30, 1,981), an additional eight 
schools were being serviced on a part-time basis. Finally, these same 
monetary restrictions prevented project management from obtaining the 
services of part-time college Students. (Refer to Appendix A for a 
list of the schools serviced on a part-time basis) 

Process Objective #2 : All project assigned tutors will attend at least 
one pre^service.and monthly in-service training workshops, conducted by 
project staff and/or consultants., 

. . Out comer This objective was attained. A general orientation^SAssion 
was 'held for three full days on September 17, 18, and 19 196TJ. These 
sessions familiarized tutors with the project's operational procedures 
and the report forms that were to be completed during the school year. 
Tutors were also presented with an introductory overview related to 
establishing rapport with various individuals who would be encountered 
while pursuing tutorial responsibilities (i.e., principal, teachers, 
students and parents) and were introduced to initial mathematics and 
reading instructional techniques. The three project consultant teachers 
were responsible for the planning and presentation of these various 
orientation session topics. A project developed reaction sheet was 
administered after each session in efforts to provide project manage- 
ment with feed-back related to the strengths and weakness of each 
presentation. Subsequent to these orientation sessions, inservice 
meetings were held on a monthly basis with the exception of the months 
of February and April. Due to the* semester break, February's meeting 
was rescheduled in March and the project consultants cpnducted -on-site 
visitations to each tutor's school a's an alternative to the April 
meeting. A tfctal of .eleven meetings were held during the school year. 
These full-day .sessions were primarily used to up-grade the tutor's 
instructional capabilities. Project management developed specific, 
training objectives and procedures as well as evaluation instrumenta- 
tion for each meeting to ascertain whether participants attained 
expected session outcomes. Details of these outcomes can be obtained 
in the project office. (A complete listing of inservice dates and 
topics appears in Appendix B.) . 

On a questionnaire responded to by 27 public and 9 nonpublic tutors 
in June of 1981, the inservice workshops were^given overall, ratings 
of Effective or Very Effective by 97 percent of the public school 
tutor respondents and 100 percent of the nonpublic respondents. One 
of every four respondents (public and nonpublic combined) indicated 
that it would be profitable to .introduce additional topics in future 
* inservice sessions in an effort to increase their instructional-^eff^c- 
tiveness. The following typify the kind of topics that were suggested: 
"provide interpersonal relationship training, suggest methods of 
* 
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V teaching mathematics problem solving,, provide more opportunity 
for tutors to share instructional ideas among themselves, and 
introduce methods of dealing with the disruptive child. » (Com- 
plete questionnaire responses can be f9und by referring to 
Appendices" H and I of this report) . 

Process Objective #3: -Tutors will work with groups of 1-2 children 
at a time, providing reinforcement - instruction in specified concepts 
and/or, skills which are the instructional, emphasis of the Project, and 
which have been identified as high priority needs of children in 
. priority schools. - 

Outcome: This objective was achieved. A review of Pupil Data^ 
Cards indicated that a total* of 2,720 tutoring assignments were 
made within the 11 mathematics and reading skill areas taught By 
the tutors. Of that total,, 2 .,434 (or 89%) of the assignments 
had complete pre and post test information available and were 
conducted for the prescribed length of time (i.e., 20 to 30 
minutes of instruction on a minimum of 30 occasion's). The 
majority of the tutoring assignments /that were conducted in the 
prescribed fanner wfere for reading skij^s (1,649 or 68%) with 
the remainder^of these assignments being for mathematics (32$ 
or 785). Within the reading skill area the majority of assign- 
ments (42%) were made in vocabulary while the second most 1 \ 
frequent skill .tutored was spelling (22%). The most frequently 
assigned mathematics skill was multiplication/division computa- 
tion (32%) with the' related skill of multiplication/division 
facts being the next most frequent (24%) assignment area. 

When 1979-80 and 19&0-81 tutoring assignment data are compared, 
it becomes evident that a complete reversal has occurred in 
the skill area receiving prime attention of project tutors. 
During 1979-80/62 percent of such assignments were made in the 
matheniatics skill, area with 38 percent in the reading area. The 
ppposite occurred,, in £980-81 with 68 percent of those assign- 
ments being madeLih reading, and ,32 percent in mathematics. This 
shift in emphasis was "ordered by project, management as a response 
to a systemwide mandate which i£en*i£?fed reading as a £rime 
instructional need in all Cleveland' Public* Schools. Table I 
presents the number and percentage of tutoring assignments that m 
were made in each mathematics' and reading skill area during the 
1980-81 school year. 
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TABLE 1 

1980-81 Resident Tutor Project .Tutoring Assignments 
By SkiJLI Area 







- Math Stfill/Code * 




Per- 


Reading Skill/Code 




Per- 


N ' 


cent 


N • 


cent 


Add/Sub Facts 


119 


6% 


Alphabet 


91 


4% 


Mult/Div Facts 


193 


10% 


Vocabulary 


702 


29% 


Add)fSub Computation 


144 


7% 


Aud-Visual Percep. 


60 * 


2% 


Mult/6iv Computation 


259 


13% 


Long/Short Vowels ' 


196 


. 8% 


Problem Solving 


70 


•3% f 


Syllabication 


233 


10% 








Spelling 


367 


15% 


Total's 


785 


32% 


1,649" 


■68% 
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Tutors were asked to record the number of students they had assisted 
at the same time during each tutoring assignment. An analysis of the 
data for those assignments conducted in the prescribed manner CN=2,434) 
indicate that the majority of such sessions (1,639 or 67%) were con- 
ducted with two studejifs, 470 sessions (or 19%) were taught with one 
student present, and the remaining sessions (325 or 14%) had three or 
more students in attendance during the instruction. 

Further .analysis 1 of, tutoring assignment data reveal that of the 1,916 
students who received tutorial service, 1,112 (or 58%) of these 
♦students obtained tutorial assistance in only one skill area, while 
804 (or 42%) of the remaihing students received such assistance in y 
more than one skill. Among this latter group,, 577 students (or 30%) v 
obtained assistance in two skills, 157 students C or 8%) were tutored 
in a total of three skills, and 70 students (or 4%) obtained fcelp in 
four skills. * * r 

In a questionnaire distributed to all tutors at the end of June 1981, 
respondents were to indicate how frequently classroom teachers wi,thin 
their respective buildings- clearly identified the specific skill the 
referred student should be taught. A total of 27 public and 9 non- 
public tutors ff^ffcaded to the question.* The majority of respondents 
from both groups (i.e., 76% public and 68% nonpublic) indicated that 
teachers within their, building "always" identified the specific skill, 
a "usually" response was recorded by 11 percent and 16 percent of the 
two respondent groups, a "sometimes" response was indicated by 13 per- 
cent and 16 percent of the two groups, and a "sometimes" response was 
indicated by 13 percent and 16 percent of the two groups. One respon- 
, dent ij> the public school group did indicate a "seldom^response. * 

When asked how often conferences were held with classroom teachers to 
"Review the work done and the progress made by the pupils", none of 
the responding tutors in either the public (N=25) or nonpublic (N=9) 
schools indicated that they "ntever" conducted such conferences. Non- 
, public respondents however, indicated that they conducted the conferences 
v on a more frequent b^sis than did their public school counterparts (i.e., 
78% of the nonpublic respondents indicated holding such meetings "about 
once a day" or "several times a week" versus 37% of the public school 
respondents, while 11% nonpublic versus 55% of the public school respon- 
dents indicated a "about 'once a week" or "less frequently" response).* 

A noted difference was indicated in v how often the public and ndftpublic 
tutor respondent groups used the Resident Tutor Manual v^^^Fhe^project 
manual provides tutors with an explanation of the procedures that 
should be followed when tutoring, exemplary tutoring activities, and 
V tests. A greater percentage of the 26 public school tutor respondents 

indicated that they "very frequently" or "somewhat frequently" used 
the manual than did their nonpublic school colleagues, (i.e., 92% 
versus 77%) . When the "infrequently" response was compared, 4 percent 
of the public tutors versus 23 percent of the nonpublic tutors indicated 



*Refer to Appendices H and I for further details regarding questionnaire 
findings , * t • t : \ 
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such a response. Neither, group, however, indicated that " they "never 11 
used the nuuual l . When the tutors were asked if they felt the manual 
should be "improved", a greater percentage of the nonpublic respon- 
dents (89%) recorded a "yes" response than did the public school res- • 
pondent group (48%) . Typical suggestions made by tutors that were 
aimed at improving the manual related' almost exclusively to the locally 
constructed tests. Included among these were: tests should correspond 
more closely to a student's current grade level, tests should.be more 
difficult, and tests should meet the needs of the in-between student 
instead of being too hard or too easy* > * 

I* I* 
Process Objective #4: Fifteen of the full -time educational aides will 
b^ assigned tp Parent 'Resource Centers in lY Titled schools and. will 
develop parent involvement activities in addition to tutoring. At least 
50\percent of, the partnts of pupils tutored by these aides will visit \ 
the\ Parent Resource Center- at least once to receive explanations of the 
tutoring {procedures and materials, be apprised of the progress being . 
made\ by their child, and/or learn tutoring techniques to be used at home 
-with \ the pupil. 

. Outcome : This objective was achieved. Examination of project records 
shoWed that; Parent Resource Centers operated by full-time tutors were 
established in 15 of the 35 public schools served by the project. 
(Refter to Appendix A f6r a complete listing of Center schools). Of 
the 619 students: served 'by these 15 tutors, the parents of 367 (or 59^) 
visrged thetenters at least once. This outcome represents* a slight 
increase in 'the percentage of total parents who visited the Center 
during\l980-81 (i.e., 59% versus 54%). When visitation data were 
examined for each Center separately, it was found that the percentage 
of visiting parents ranged from 27% to 100%.— Eleven of the 15 Centers 
met the\criterion prescribed in the object iye. This outcome repre- 
sents an\ improvement -from 'the preyious year when nine of the 15 Centers 
met the identical criterion. The records further reveal that from 
one to 23V parent meetings were held at the Centers. A total of 80 such 
meetings we re he ld with tlfe median number per Center being 5.5. The 
total number of meetings held in the Centers decreased by 28% from the 
previous y^ar (i.e., from 111 meetings in 1979-80 to 80 meetings in 
1980-81). At least one meeting was held in each Center during 1980-81. 

Tutors whp had managed Parent Resourcie Centers were asked in June 
of 1981 hov^ iriuch they "agreed" or "disagreed" with nine statements 
related to Center operations. A review of the responses made by the 
13 tutors who returned questionnaires revealed that seven of the nine 
statements received a "strongly agree" or "agrep'^resjponse -by 92 
percent to 100 percent of the respondents. .One respondent did indicate 
a "not sure" response on three of these seven statements. Among these 
seven questions Were the following: "Classroom teachers in my building 

• believe that the\Resource Center is needed in this school", Parents 
like the Resource\ Cent er's instructional materials", and "I have been 

. a^eguately trained in how to manage the Resource Center". The two 

* questions that obtained the least agreement among tutors were the 
following: It is very difficult to get parents to use the Resource 

\Center. (55% of the respondents indicating a "stropgly agree"/ M agree" 



*Refer to Appendices H and I fpr further details regarding questionnaire findings. 
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response, 30% indicating a "disagree/strongly disagree 11 response, and 
15% responding "not sure 11 ) and lr The Resource Center has an adequate 
number of instf&ctivial materials 11 086% of the respondents indicating 
a "strongly agree'^'agTee" responses and 16% responding "disagree/ 
"strongly disagree") . , » (Refer to Appendix J for complete details re- 
garding the Center questionnaire findings). . 

In an effort to qbtain school principal "feedback^Vegarditig project 
operations, program management designed a questionnaire which was 
distributed in June, 1981. All principals (N=15) whose building 
housed a Parent Resource Center were asked .to rate the Center's 
"worth" to parents, staff and pupils. Of the 14 principals who res- 
ponded, ten (or 71%) rated the Center's value as '(excellent" while 
the remaining four respondents (or 29%) indicated a "good" rating. 
(Refer to Appendix M for a complete review of questionnaire outcomes) . 

Process Objective #5: Priority will be given to serving students who 
are eligible for but not served by one d£_jfehe following Title I pro- 
jects: Reading Improvement Program, Reading Strategy Program, and 
Mathematics Skills Improvement Program. 

. Outcome: This objective was achieved. In an effort to insure that 
Title^I eligible^puDils in Cleveland's elementary schools parti- 
cipate in a suppofr program that most efficiently meets the need(s) 
of each student, a comprehensive assignment procedure was developed 
by the * Department of Compensatory Education. The following 
briefly outlines'*the procedure used during 1980-S1. All persons 
employed with Compensatory Funds in each Cleveland elementary 
school formed ^ team whose major responsibility was to identify 
pupils eligible for compensatory reading and mathematics services. 
To accomplish this task, team members surveyed available stan- 
dardized test data to confirm student eligibility. Complete 
information pertaining to each 'eligible student was placed on a 
standardized Pupil Enrollment Form. The completed forms were 
organized according to subject area eligibility. Program placement 
of students was made according to a project priority list estab- 
lished for each of three elementary 'schopl types existing in 
Cleveland (i.e., schools with Grades 1-3 only, Grades 4-6 Qnly, 
and Grades 1-6). The forms- for pupils iiot^ immediately selected 

- for service by the projects were filed \n a waiting list section. 
Students from Grades 4-6 who had been placed on, the waiting list 
were serviced by the Resident Tutor Project' with priority being 
given to those njost in need of reading assist ajipe. The procedure 
appears to have eliminated the possibility of providing unnecessary 
duplication of service to eligible students. (Refer to Appendix F 
for a copy of the Pupil Enrollment Form' and a detailed description 
of the eligibility procedure) . ' \ 

• ■ - i ' 

Product Objective #1: After a minimum of 30 tutoring' sessions of 20 to 
•30, -minutes on a specified reading concept and/or skill, 50 percent -Of a 
sample of participating pupils will show a gain of 15 percent or more on 
a project constructed test measuring mastery of that concept and/or skill 
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• Outcome: This objective was achieved* A total of six reading 
skill tests developed bv^project staff were administered to 
referred students on a pre and post basis . Pupils were adminis- 
tered only those tests appropriate for the skill Cs) in which they 
were being tutored. Separate versions of each skill test were 
developed for use with students in Grades 1-3 and Grades 4-8* The 
total number of items contai^d on each test varied from 10 items 
(vocabulary tests) to 25 items alphabet and syllabication tests) . 
The median number of questions per test being 20 items. Scores 
were "reported according to the percent of total item correct* , *' 
(Refer to Appendix G for an example of a reading skill test) .' 

Examination of the test scores available for 1,649 completed tutor- 
ing assignments showed that students who were involved in 96 
percent of assignments achieved a pre-post gain of at least 15 
percent. When the results were analyzed separately for each skill 
area, the percentage of achieving a gain of 15 percent or greater 
was found to range from 94 percent to 100 percent. The size of 
the gains achieved by the students averaged 41 percent, from pre to 
post testing. These outcomes were almost identical to the pre- 
vious year's when the percentage achieving a gain of 15 percent • 
or more ranged from 94 percent to 100 percent and averaged 43 
percent. (Appendix C contains complete details regarding student 
pre-post reading test performance) . 

Product Objective »#2: After a minimum of 30 tutoring sessions of 20 to 
30 minutes on a specified mathematics concept and/or skilrfc, 50 percent of 
a sample of participating pupils wijl show a gain of 1'5 percent or more 
on a project constructed test measuring mastery of that concept and/or* 
skill. , c < 

. Outcome: This objective was achieved. A total of five mathematics 
skill tests developed by project staff were administered to referred 
students on a pre and post basis. As in the reading test area, pupils 
were administered only those tests appropriate for the skill(s) in 
which they were being tutored. Separate versions of each skill test 
were. developed for use with the primary (Grade 1-3) and upper elemen- 
tary (Grade 4-8) students. The total number of items contained on each 
test varied from 10 to 20 items with the median number of items per 
test being 20 items. Scores were also report edi according to the 
percept of total items correct. (Refer to Appendix G for an example 
of mathematics skill test). 

A review of test score outcomes available for 785 completed tutoring 
assignments indicated that students who were involved in 96 percent of 
the assignments achieved" a pre-post gain pf at least 15 percent. When 
'-the results were x analyzed separately for each skill area, Ahe percen- 
tage achieving a gain of 15 percent or greater ranged from' 85 percent 
to 100 percent. The size of the gains achieved by the .students aver- 
aged 51 percent from pre to post testing. These outcomes demonstrated 
t*at during 1980-81 students demonstrated a slight improvement in 
their mathematics achievement when compared to the previous year (i.e., 
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the percentage achieving a gain of IS percent or more raiiged from 94 
• to 100 percent and averaged 43 percent dui;ingM979-80) A (Appendix D 
contains complete details regarding student*pre-po£t mathematics 
test performance) . V , * 

Product Objective #3: After a minimum of 30 tutoring sessions of 20 to » 
30 minutes each on specified reading skills, the,me£n posttest NCE 
score will be 7 units 1 higher "than the jnean pre-test score for a sample 
of pupils in Grades 4 through 6 using the appropriate subtests of the 
Stanford Diagnosti9 Reading Test appropriate ^o the reading skill being 
tutored. * ' % / 

. Outcome; This objective was achieved.' The Stanford Diagnostic 
Reading Test CSDPT) was administered in October, 1980* to all public 
school students in Grades 4-6 as part of the city-wide testing pro- 
gram. This administration served as the pre-test for project- 
students in the participating -public schools. Following the com- 
pletion of tutoring in a specified reading skilly each student was 
again administered th^ test by his/her tutor, but only in the subtest 
that corresponded to the skill tutored/ This evaluator conducted two 
inservice sessions during the beginning of each semester in 1980-81 
to insure that alj tutors adhered to the proper procedures when Ad- 
ministering the SDRT. Although nonpublic school tutors conducted 
reading instruction, students .were not administered -the SDRT duetto, 
the absence of a city-wide test program. 

Pre and post SDRT scores were converted to -NCE scores using fall snd 
spring norms respectively. Appendix E provides a grade- level summary' 
of the SDRT scoreSfor each of, the four administered subtests. More 
than half (64% or 272) of the 425 referral 0 assignment's made in the 
four reading areas requiring SDRT administrations pertained to. the 
assistance given in the auditory vocabulary skill area. Examination 
of the pre and post NCE means .showed that. gain scores ranged from a 
low of 12.00 (Grade 6 - phonetic analysis) to a high of 27.86 (Grade 
S-Structural Analysis). All grades (4-6) exceeded the criterion of a 
gain of 7 points set in .the objective on each subtest. The current 
ytfar (1980-81) mean gains exceeded those attained by students during • 
the previous year (1979-80) in each of the' subtest areas with' the ex- 
ception of Grade 5 students f on- the phonetic analysis subtest. 

A further review of the SDRT outcomes indicate that in 78 percent of 
the assignments conducted by the tutors, students attained a pre-post 
gain of at least 7 points. "When th#£e! results 'were analyzed separately 
for each skill area, the percentage of students achievmg the proposed 
criterion gain ranged from 61 percent to 100 percent. The size of the 
gains achieved by the students averaged 21.25 NCE^points. 

The request is frequently made to relate prdyect achievement to the 
national norm group. Such a comparison can be made through the use 
of a percentile riorm group. A percentile rank for a given test score* 
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indicates the percent of pupils at a particular grade placement 
in the national norm group who received scores equal to or lower 
than the given score. Table 2 presents the percentile rank of the 
mean pre/post NCE scores v attained by the project students who 
were administered the SDRT. 

TABLE 2 

Percentile Rank on National Norms of Mean Pre and Post 
Scores on Subtests of the Stanford Diagnostic Reading Test 
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: Percentile Rank \ Percentile Rank 

Grade Subtest ' N of Mean Pre Score Trf^Mean Post Score 

4 Auditory Vocabulary 75 17 

Phonetic Analysis 2 14 

Structural Analysis 24 20 

Auditory Discrimination 1 24 

Auditory Vocabulary 127 15 

Phonetic Analysis -40 13" 

Structural Analysis 44 14 

Auditory Analysis 70 21 43 

Phonetic Analysis 5 29 50 

Structural Analysis 37 . 16 41 
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Table 2 shows that on the pre- tests the average scores of project 
students were mostly in the lowest 20 percent of children nation- - 
ally. A similar outcome ^was demonstrated during the previous year. 
The expectation is that without project services, their scores $ 
would remain the same relative to children nationally^—Post-test 
results, however, show that in each subtest area Grade 4, 5 and 6 
students achieved substantial growth beyond what would be expected. 
All ^group average post subtest scores approached or exceeded the 
Average score (50%) nationally. The small numbers of students for 
whom test scores are available (particularly, in the phonetic 
analysis an^auditoiy discrimination subtest area) suggest that 
caution be excerised in interpreting results. When the 1979-80 
and 1980-81 post-test scores are cdmpared, the growth pattern re- 
corded by Grade 4,. 5 and 6 students demonstrated further improve- 
ment in all subtest area^with the exception of the Grade 4 
analysis outcomes. Improvement was particularly striking at Grade 
6 V During 1979-80 Grade 6 student post scores on two of the three 
subtests 1 indicated that they fell farther behind in achievement 
despite project assistance. Current Grade 6 results demonstrated 
a complete reversal of this* pattern in that-students have evidenced 
substantial growth in each subtest area. (Refer to the 1979-80 
project evaluation for complete percentile results). 
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ADDITIONAL FINDINGS 



Efforts were made to ascertain how various groups viewed theiy in- 
volvement in 1980-81 project activities. To accomplish this, a variety of 
questionnaires were developed to obtain the perceptions of those who had 
direct contact with project services. Those questionnaires wefe distributed 
to project and non-project staff, school principals, and students in June of 
1981. The following highlights the major findings obtained from the responses 
of 27 public school tutors, 9 nonpublic school tutors, 21 nonproject teachers 
from public schools, 10 jionproject teachers from nonpublic schools, 32 
principals, and 55 students. 

. When asked to indicate what had been the "greatest problem" 
tutors encountered as they assisted students during the school 
year, the problem most often cited by the 22 responding public 
school tutors related to th§ir attempts to maintain the proper * 
racial balance among the students they assisted (6 of $he 22 
respondents or 27% indicated such a response) . Additional pro- 
blems cited by more than one respondent included: the inappxopro- 
priateness of adhering to a 30 session instructional period for 
each student (i.e., 3 of the 22 respondents indicated that * 
various students needed less or additional time to master a 
(particular skill) and the difficulty in obtaining an adequate 
number of eligible students to tutor (i.e., 3 of the, 22 respon- 
* dents indicated that this problem was especially ^bothersome in 
those buildings with more than one Title I reading project). 
* Nonpublic teacher respondents (N=9) did npt reach a consensus 

when asked the same question. Included among their varied 
responses were the following: "the amount o£^ children available 
for our program", "disciplining the students" and "record 
keeping". (Refer to Appendices H and I for complete results) . 

. ■ A total of 16 of the 27 public school tutors who returned 

questionnaires provided recommendations that they believed would 
improve the project next year. Those recommendations "made by * 
more than one respondent included: developing a more equitable 
plan with other Title I projects to obtain a greater number of 
eligible students for tutoring (four respondents made this re- 
commendation) and revise the project reading tests making then* 
more challenging (two respondents made this recommendation). ) 
Three of the nine nonpublic tutors indicated that the tutor' manual 
and tests should be revised. (Refer to Appendices H and I) . 

« • *" * 

. Three typ'es of responses were obtained from nonproject public 
school teachers when asked to indicate what changes they would 
make to improve project operations. Although 21 teachers returned 
questionnaires, only eight provided such recommendations. The three 
types of v suggestions that were provided included: find ways to ser- 
vice more students (five respondents), increase the involvenjent of 
classroom teachers in developing tutorial objectives for each 
student (two respondents) and permit students who need additional 
assistance to master a skill, to remain with the tutor for. mpre than 
30 sessions (one respondent). The ; most often cited recommendation 

i # ■* 
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made by nonpublic teachers related to developing a closer relation- 
ship between tutor and teacher when defining the tutorial 
instructional approach for each student (three of the four respon- 
dents who. provided recommendations responded in this mariner) . 
(Refer to Appendipes K and L for complete nonproject teacher sur- 
vey results) . 

. Principals were also asked to indicate what "features 11 of the 
project y they felt needed Modification and/or deletion 11 . More 
than half £53%) of the 32 principals who returned questionnaires * 

' provided responses to the question. The most* common contribution 
made by (6 of the 17 .respondents) related to relaxing the student 
eligibility requirements in order that a greater number of pupils 
could be served by the project. Principals making this recommen- 
dation urged that classroom teacher^ judgement be emphasized when 
selecting students. Other r ecommendat ion s % . included: reducing 
the amount of paperwork required of tutors, conducting fewer 
inservice sessions for tutors during the year, and re -instituting 
the. involvement of students in Grades 1-3. (Refer to Appendix M) . 

. A review of the student questionnaire responses obtained from a 
random sample of public and nonpublic students revealed that 96 
percent of the group "liked getting help from my tutor 11 with the 
Remaining students (4%) indicating a "not sure" response. A 
smaller percentage of respondent s, # however, indicated that they 
would like to "get help" from ^ tutor next year (i* e «» 76% 
responded "yes", 7% responded "no", and, 17% indicated a *"not 
sure 11 response). An overwhelming majority of these same students 
(95%) indicated that they felt their tutor did help them "do ♦ 
better in school" with a 5 percent indicating a "not sure" response 
(Refer to Appendix N for complete student survey results) . 



CONCLUSIONS - 

A summary analysis of 1980-81 Resident/ Tutor Project results revealed 
the following outcomes. Due to budgetary reductions, the project served fewer 
sehools than previously and some schools obtained only part-time services of a 
tutjor during the second semester. The Qewly appointed program manager required 
that projelct consultant teachers develop objectives as well as evaluation pro- • 
cedures for each staff orieiitation/inservice training session conducted. Parent 
ResgurceyCenters were in selected schools to provide parents with suggestions * 
of how they could assist their cRifd's skill development at home. 

• The majority of tutoring assig^fcnts completed by project staff were . 
in the reading' rather than mathematics stUb area. More than half of the 
'students obtained instruction in one rea^^L or Mathematics skill area pnly. 
Tutors conducted most of their asSignmenH^Lth two students being present 
during the instruction. When student achievement results were ''analyzed, pro- 
ject students demonstrated performance levels that easily exceeded the 
criteria prescribed in both the reading and mathematics subtest objectives. 
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The standardized reading test performance (SDRT) of 1980-81 student partici- 
pants npt only exceeded the criteria prescribed in the proposed objective, .but 
demonstrated a noted improvement when comparisons were made with the previous 
year's results. » 

Based^on an extensive p**iew 9f current (1980-81) project related 
data, this evaluator provides the following recommendations for consideration 
when making future operational planning decisions. 

■ ' . • ) 

. With the prospect of continuing budget reductions and the fact 
that program management was forced to reduce^project services on 
a part-time basis in nine* schools during 1980-81, it is critical, 
that future tutor assignments be made in those schools which 
possess the greatest number of eligible students who cannot be 
Serviced by other Title I projects. To accomplish this task, 
staffing decisions for "all elementary Title I projects must be ' 
made early enough to allow for the proper placement of tutors 
prior to the start of the new school year.* A? presented in the 
Additional Findings section of this report, at least 3 of 22 
tutor respondents in unsolicited comments alluded to experiencing, 
difficulty in obtaining enough student participants. This 
appeared to be particularly true in those ^schools which possessed 
at least two additional Title I projects. Mn addition, further 
investigation should be made to ascertain how successful part-time 
assignments have been before such a practicev^s continued or dis- 
carded. It is not recommended, however, that f^acher judgements 
replace standardized test data as the primary method of identify- 
ing potential eligible students as principals have suggested. 

. As presented, a great number of tutors have recommended that the 
project's instructional manual and skill tests be revised. Cited 
as reasons for such a recommendation 'were that students tended, to 
get bored with the activities suggested a in . the manual and "the 
skill tests were oftentimes not suited to "the grade level place- 
ment of the student with some finding them too difficult or easy. 
With respect to the l&st recommendation, one must be reminded 
that such tests were originally constructed to determine wh'ether a 
student had mastered^ a specific skill after receiving tutorial* 
assistance. Consequently, it should not be' surprising to find an 
overwhelming majority o^students routinely scoring well on the 
post administration of such tests. It is therefore recommended that 
prior to' enacting any revision process, program management investi- 
gate the specifics of such recommendations thoroughly. * 

. As cited in this" report, a common recommendation made by public 
and nonpublic tutors involve questioning the benefits ,of adhering a 
to 30 instructional sessions per student. It was indicated that 
some students mastered the specific skill prior to 30 sessions, 
while others needed additional time to do the same. This evaluator 
is unaware of any data which suggests thatT"it is more or less 
beneficial to adhere to a fixed number of sessions when tutoring 
individual students. A more complete study of this issue may 
- provide insight that will contribute to insuring effective use of' 
tutor time. 
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More than half (55%) of, the responding tutors who were responsibL 
for Parent Resource Centers indicated that it was difficult to 
obtain parent involvement. Program management has recognized the 
importance of ^briaging project personnel and parents together 
often to dismiss how instructional support can be provided in the 
home. The special activities scheduled in the Centers during 
April and May attested to tjiis concern and appeared to be rela- 
tively successful. It is crucial that efforts continue to be 
made to provide more parents the opportunity to obtain practical 
teaching suggestions and aids that can be ^easily vged with their 
children. 
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Public Schools 



APPENDIX^A * 

Schools Serviced by the Resident 
Tutor Project During the 198(M*T 
, : Sthool.Year ; 



Andrew J. Rickoff § 
Anthony Wayne 8 
Buhrer # , 
Case 

Charles La*ke 9 
Chesterfield 2 * 
Tlark # 
Cranwood § 
Daniel Morgan @ 
East Madison 
Forest Hill Parkway 
Pullerton 
Garfield 

George W. Carver 
Gordon * 

Henry W. Longfellow 
Kenneth Clement 
Margaret Ireland • 



T 



fton Public Schools 



Immaculate Conception 

Oir Lady of Peace 

St. Adalbert 

St. Benedict 

St. Francis 

St. Joseph Franciscan 

St. Michael 



^ Marion -Sterling $ 

Mary B. Martin 
✓ * Mary Bethune « 
\ Miles Park*' •» 
Vf^lford 

Wount Pleasant * 
Oliver H, >erry@ 
AOrchardG* " 
*Paul Revere^ 
Robert Alton? 
Stephen i, Howe • 
Ttfemont 
Union 

Verda Br<H>st # . 
Wade ferk^ 
Waltdn * : * 
Waterson-JLake s 1 
x Wil.low C-j^ 



St. Philip llpri 
St. Stepheh * 
St. Thomas Aquinas 
St. Timothy * 
St. Wendelin •„ 
Urban Community * 



"^ScKoo^erviced by a part-time aide between September 8, 1980 to June S, 198K 
'Schools serviced by, a part-time aide fctween March 16, 1981 to June 30, 1981 
^Schools containing a Resident Tutor Parent Resource Center. 
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APPENDIX B 



Description of Resident Tutor Trainingygessions Held During 1980-.81 
Date (s) ' Type of Session(s) * .' < Topics Featured at Session(s) 

Orientation 



September 17, 18 
and 19, 1980 



October 



1980 Inservice 



Noveaber 26, 1980 Inservice 



December 17, 1980 Inservice 



January 22, 1981 Inservice 



February 26,1981 Inservice 



March 24 

and 26, 1981 



Aprii, 198r 



May 13,28 and 
June 29, 1981 



Inservipe 



Inservice 



. ^Review project operational procedures and forms 

Provide training in the creation*"Jbf tutor lesson 
a» plans . 

Introduce an'pverview of hoir to teach reading 
Prepare for teaching math in a tutoring^ession 
Introduce methods that, can establish rapport with 
principal, teacher, tutee, and parent 
* 

Introduce ways to provide students with practice 
in multiplication and division skills 

Introduce" ways to provide students with basic 
phonics skill practice 

Learn to develop vocabulary lessons 

Review procedures related to good lesson plan 
construction ^ 
*. Review new mathematics and reading instructional! 
material 

Discuss special concerns held by tutors 
Obtain training in the administration of the Stan- 
ford Diagnostic Reading Test * 

Learn to construct games which reinforce mathe- 
matics and reading skills 

Introduce the game of Tea, Kettle , (a game o'f 
homonyms) * 

Introduce methods designed to teach spelling 

Provide techniques found effective in preventing 
problems ^o occur when reading addition 

. *Hear a presentation by the Supervisor of Elementary 
Mathematics related to new teaching techniques 
Introduce techniques which contribute to legible 
cursive handwriting • 

' ' % 

Invite one parent from each school to attend 
presentation made by Supervisor of Eieaentary 
Reading Language Arts regarding parent involvement 

Review project »goals £or the 1980-81 school year 
Review standardized testing procedures ^, 
• t Obtain instruction in how to teach syllabication 
Develop, lessen plans -related to syllabication 5 
Hear a presentation regarding the 1 979-80 "project 
evaluation * ^ 

No workshop schedule^. J*roject v consultants conduct 
on-site visits to each tutor ' s \schooL as follow-up 
to March inservice session activities 

* * „- • ' 

Collect all project related records and evaluation 
data . 
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APPENDIX C 

- Resident Tutor Project Reading Skill Test Results 



Subtest /Code 



Pre Mean post Mean 

Grade ^ Percent Correct Percent Correct 



Mean 
Percentage 
Gain 



N/% Gain 
-♦15,00 « 



Obj/ 
Attain. 



Alphabet 
• IbKlll Code 210) 


1 

2 


41 


32.07 


92.43 


s a +60.36 


41/100% 


* 




3 


6^ 


32.00 


90.66 


♦58.66 


6/100%,^ 


* 


y 


4 


23' 


34.56 


82.52 


♦47.96 


23/100* . 


* 




5 


12 


29.16 


66.83 


♦37.67 


12/100% x 


* 




6 
7 
8 


9 
- 
■ 


41.55 
^ -- 


$2.33 • 
-- 
-'- 


♦40.78 
— 
-- 


9/100% • 
— 


• 
- 
- 


•Vocabulary 






♦ 




/ 


'* 




(Skill Code 220) 


1 


12* 




'"71 CC 


' +39.16 


11/91% 


* 


/- 


2 


24 


•39.58 


83.87 


' +44,29 


23/95% i 


* 




3 

4 


25 


40.00 r 




1 +40.40 


«24/96% 


* 




253 


36:49 


♦40.64 


243/96% 


* 




5 


277 ' 


40.82 


84.45 


«, +43.63 


267/96% 


* 




6 


108 ' 


43.24 , 


82.52 > 


♦39.28 


102/94% 


* 




' 7 


1 


2o.oor- 


SO. 00 


♦80.00 


1/100% 


* 




9 8 


2 


20.00 


^ J00.00 


+80.00 


2/100% 




. ,Aud -Visual Percep. 


1 


'''23 


41.30 


82.60 


+41.30 


23/100% 


• 


(Skill Code 230) 


2 


12 ■ 


45.00 


84.58 


+39.58 


12/100% 


* 




3 
















4 


9 


38.22 * 


81.66 


+43.44 


9/100% 


* 


4 

4 


5 


14 


56.42 . 


* 80.35 


+23.93 


14/100% 


* ' 




6 ► 


2 


52. 5D * 


87.50 


+35.00 


,2/100% 






-7 
















8 


-0 













Long/ Short Vowels 
(Skill Code 240) 



43 


31.97 , 


72.90 


+40.93 


47 


38.29 


78.51 


+40.22 


IS 


40.00 


91.66 " 


♦61.66 


27 


42. 96 * 


74.2S 


+31.29 


55 


40.52 


85.10 


+44.58 


6 


42.66 


* , 90.50 


+47.84 



43/100% 
47/100% 
18/100% 
24/88% 
54/98% 
6/100% 



Syllabication 


4 1 










r 




(Skill Code 250) 


2 


9 


4i'ir > 


83.33 


+42.22 


9/100% 






3 


10 


43.00 


77.00 ' 


+34.00 


10/100% 






4 


71 


■ 43.12 


80.18 


+37.06 


64 / 90% 






5 


, 87 


49.24 


83.47 


, +34,23 


83/95% 






6 


56 


43.44 


80.07 


'♦36.63 


54/96% 






7 














j 


8 


» 


— t . 











Spelling 

(Skill Code 2)50) 



2 


14 


44.28 


84.28 


+40 


00 


14/100% 


3 


16 


38.12 


77.81 


+39 


69 


16/100% 


4 


12^ 


40.36 P 


80.54, 


+40 


to 


125/96% 


5 


> 148 


38.58 


76.33 


♦37 


75 


140/94% 


6 


59 


41.52 v ~ 


79.40 


♦37 


90 


56/94% 


7 
8 


. i 


34.00 y 


30.00 


- 4 


00 


e 



9 

ERIC. 



♦ Objective* criterion attained (i.e., 50 percent of a sanple of participating students will - 
show a gain of 15 percent* or nore). • , 

^75 
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APPENDIX D 

Resident Tutor Project Mathematics Skill TeSt Results 



Subtest /Code 



Grade N 



/Pre Mean 
Percent Correct 



Post Mean 



Mean 
Percentage 



N'/%Gain Ob j . 



Add/Sub Facts 


1 


26 


29.38 


77.76 * 


4 

♦48.38 


24/92* 


* 


(Skill Code 111) 


2 


44 


33 . 27 


88.22 


♦54. 9S 


43/97% 


* 




3 


18 


41.55 


• 91.88 


♦50.33 


18/100% 


* 




4 


• 14 


52. Q7 


90.64 


♦38.57 


13/92% 


* 




5 


- 13 


v 46.30 


• 74.07 


♦27.77 


13/100% 


* 




6 


* 4 


4,8.50 


74.00 


♦25.50 


4/100% 


* 




7 

' 8 















Mult/Div Facts 
(Skill Code 112) 




40.00 
$6.57 
•33.98 
39.78 
38. ft 



60.00 


♦20.00 


1/100% 


* 


75.42 


•♦38.85 , 


6/85% 


* 


84.47 


♦50.69 


88/97% 




84.03 


♦44.25 


56/91% 


♦ 


80.11 


♦41.75 * 


34/100% 


• 



Add/Sul? Computation 
* (Skill Code 12J)' - 



1 
2 

+i 

S 

6' 
' 7 
8 



11 
18 
71 
24 
20 



36.36 
43.88 
42.38 
44.29 
42.50 



*7.J2 


♦31.36* 


* 11/100% 


* 


80.83 i 


♦36.95 


18/100% 


• 


83.94 


♦41.56 


69/97% 


* 


86. 2S 


♦44.96 , 


• 23/95%, 


* 


76.50 


♦34.00 


, • 20/100% 


* 



Mult/^iv Computation 1« 

(Skill Code 122) 2 

v . , 3 
4 

• 5 

- . ' 6 

; v 7 

• . 8 



73- 
88 
97 
1 



Problem Solving 
(Ski|l Code 131) 



37. 3S j/t 

33.23 w 

3S.S7 

10.00 



1 


V 4 


3S.00 


2 


1 




>3 


20 . 


. 21. 00' 


4 




29.00 


'5 


. 13 


.30. 00 


,6 


8 


2S.38 fc 


7*» 


3 


10.00 


8 




10,00 6 



?7.3S 
79.77 
80.27 
1-00.00 



77.50 

80.00 
74. SO 
76. U' 
82 ^0 
97.50 
jOO.OO . 



♦40.00 
♦46.;54 
♦44.70 
♦90.00 



£8/93% 

87/98% , « 
33/95% * 
17100% 



♦42. 50 


• 4/100% - 


♦S$?ob* 


4/i0O% 


♦4S.50 


20/100% 


♦46.11 


• 18/100% ' * 


♦56.92 


12/92% 


♦86. SO ' 


8/100% 


♦90.00 


3/100* 



i 



• Objective criterion attained (i. 
of 15 percent or more) . ~ 



e. t 50 percent of a sample of participating 



studenrs will show > 



\ 



APPENDIX E 



Resident Tutor Project Stanford Diagnostic Reading Tests Results 



Pre X Post X NCE N/* Gain 

Subtest/Code Grade N NCE Score NCE Score Gain 7 NCE 



Objective 
Attained 



Auditory 
Vocabulary 
(Skill Code 220) 



75 29.75 ,45.69 +15.94 60/80* 



5 ' 127 27.89 54.36 +26.47 108/85* 

V 

6 70' 32.93 45.96 +13.03 43/61* 



T 



Audi tory 
Discrimination 
(Skill Code' 230) 


4 


1 


35.00 


49.00 


+14.^0 

■ \ 


1/100* 


. ■ ) 


, Phonetic Analysis > 
. (Skill Code 230) 


5 

» 6 




Combined i*ith 'Skill Code 2'40 
Combined with Skill Code 24jQ 






Phonetic Analysis'' 
(Skill Code 240) 


4 


2 


. 27;oo 


'48.00 


+21.00 , 


2/100* 

r> 


# 


* 


5,, 


40 


25.75 


47.98 


♦22.23 * 


33/75% 






6 


5 


38.40 


50.. 40 * 


+12,00 


4/80* * , 




Structural 
j, Analysis 

(Skill Code 250)' * 


4 


24 


32'.38 


47.21 * 
• 

* 


+14.83 


" v t 
17/71* 

t 


* 




5 ' 


44 


26.66 


54.52 


♦27.86 


9 

41/93* 





37 29.24 



44.76 



♦JS.S2 26/70* 



* Objective criterion attained (i.e. , mean NCE gainlL +7) , 
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APPENDIX F 

pwcewl tor csuKiis/n /.'s school c aw'£MS*TffK'y qic/cum ifST 

■ ' ; 1 t 



. Make-up oi litle I Team . . .Setcc&on o{ Tavn LeadcA 

. A44-C9nmcii£ otf Pupils to Programs 

. SeXtutg up Title I rf-ttc 

. Reporting far Title I Census ^o^i Re4caAc/t) 

THE COMEUSATQZV TEAM u*££ ccn^t of all persons employed with Compensatory 
, Fund* -cn -die buuttoig. Tills milt include both ceAttgiaited and non-ztAtiiiaUed' 
personnel. J 

' THE TEAM LEAVER icitt be a p&t&on agreed upon by the Project Managers oi Reading 
andiiatJi programs operating in the building. He/She should have ability to v ' 
organize the work and lead tlie team. Experience uUth &orm mil be. help\ul> 

Duties - Team Leaders 

11) LuLtion uxth Principal regarding all matters related 
to team activities and the Szhool Eligibility Pile 

(2) Receive &otunS or a manuals a 

(3) Call and conduct meetings . < 
14) distribute £crpi and maivuals , 

(5) Set up and maintain iiling system {system uUtl be 
uniioAm in all builduigs.) 

» -* 

FIRST KEFTIHG - Team will meet uxUh principal to discuss plans far suAvevina 
clxLSsem to be involved. * ♦ ^ * 

SFCflAfl IffETLVG - > C^Ai^r-i wct/t pup^' eligible Ioa services o{ programs ' ' 
o^eAed -u: bci^tiuA lattt be divided among the team members ior surveu > 
purposes. Enrollment foAms handed out at this time. . 



Ttam-membeAS i^imeW.cu^, Lists, ok caAds IvUtli^iniormation relative, 
to the s elecUx>n "^n^vUn^or each ptogran) £or the classes they mil cover. - 

SPZM TEST SCORES mLU be ush^ior the initial scAtzning ior eligible pupils 
KEA1WG imOVBXM: t \A*lf y At or betou 33 UU m 
REAPING STRATEGY * 4 - 6 / » 

REAPING CEWTER * 4 - 6 x • * 

MATHEMATICS SKILLS 1UPMVEUEHT r^f A 

CLEVE, m* TEST 501 OK Itss 

. CoB»tete att inioimation-on the top kali oYtix^-h^ except: 

(/) Exit Code (To be iilltd in u?/iejt papit ta»vcAj 
• . I?) Aat/]0Aiz^t5 ^natii^e (Td be tOterf it Project 
OUict.) < ^ ^ 
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APPENDIX F (Cont'd) 



Usajiq in&oimzUon av&Uabtz nf- ttht nxAultA , bill in tht inhumation ntquintd 
next to* tht tu>t on tut* that quality tlit pjupil ion *tnvict. THIS MLL INCLUDE 



BOW REAPING TESTS AND MTU TESTS. 

NOTE: A FORM SHOULD ONLY BE FILLED OUT" IF *THE PUPIL SCORES IN 
f THE RANGE .INDICATED PREVIOUSLY THA^T/OULD MAKE HIM/HER 

ELIGIBLE IN READING OR MATH OR BOTH. 

0 

THIRP MEETING - Ttam mtmbvt* bning tixt &ow> that thty havt iilltd oat, gnouptd 
acconduig to cla**. ^ 

biitkin tach cla** gnoup, ionm* should be *tpanattd according to tht fallowing 
*ubjtct anta eligibility '* 

REAPING 

LEAPING AM UAT\\ 

Vnognam *tltctlon ion tach pupil may be madt acconding to tht iollovting pnionltite 
School* Gnadt* 1 - 3 p * 

' Ufi 

ENGLISH AS A SECOND LANGUAGE* 
LEAPING imdVEUW 

HEAVING jmCT , 1 \ 

fc ScJiool* Gnadt* 4-6 

LAU < ' 

ENGLISH AS A SECOND LANGUAGE 

HEADING CENTER - Pupil* pntviou*ly diagno*td a* long tOun 
REAPING>STRATE6y AM? UATH SKILLS - Divide, pupil* ion naual 
halance. and*^on*ult togtthtn with cla**noom ttaditn. 
TeacheA vtill dtddt tvhtlhtn pupil* Aepexve eithtn on 
both pnog'nam*. CJbu^noom ttachtn-uxill initial bt*idt 
tht tznviek ttltcttd ion tht pupil*. * 
RESIDENT TUTOR - Waiting List Pupil* / 



s- 



School* Gnadt* 1 - 6 

LAU. r - v . • ' 

' ENGLISH AS A SECOND LANGUAGE « . ^ 

. REAPING JAfPROVEliEtfT 
. REAPING DIPACT ■ 
UATH SKILLS ^ / ~ > 

» teiPING CENTEX f fupiJl* pntviod*ty diagno*td a* long Ltnm \ 
. REAPING SKATEGV AND HATH SKlLlS - {CootfeAattve 
p*oc£^atc a4 -at 4 - 6 4c/ioo£a) 
RESIPD/T TUTOR T Waiting lu£ Pupil* . 1 ^ 
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* APPENDIX F (Cont'd) f. 

it'/icii pAogiam 6tto.cXA.on has been made, the pzMonis) scAvicing tka,t pupil itilt: 

. Place a check by the name ol the pAogtan to Xndiea.te tliat 

the pupU KiCC be ewiotled. 
. Till in pxogiam nurnbeA [SEE AMA/lMl) 

SeAvicing pcison will tlien distAibute loins as lolloiu: 
. White and yellow copy to pAoject olliee 

. Viiik ionm to be iiled alphabetically by homeAoom In school lile 

NOTE: SHOULD PUPIL BE SELECTED FOR TWO PROGRAMS (READING AND MATH) A 
FORM FOR EACH PROGRAM MUST BE MADE. THESE TWO WILL BE CLIPPED 
TOGETHER IN FILE." 

torn* ol pupils not selected Ioa seAvice my be iiled in the halting Ltit i&ction 
ol the lilt, All copies should Aemin togttheA. They will not be Aemoved from' the 
Waiting List section until pupil it> picked up Ioa seAvice. 

FOURTH TEW MEETING - Should be caZUd by tzar teadeA when Atsults o& Tall testing 
aAe available ii^moAe tlian one. pfioject in building 6 elects pupils lAom this test. 
Qthvudse, teacheA £\bm the project using fall scopes [ex. Reading Strategy) will 
secuAe own infavuUion from classes teAved. 



' jpOCEVimtFCZ TWISTER OR THERMAL - ACTIVE FILE 

V/ ^^ithdAawals 

The seAvicing teacheA will be tes&nsible Ioa notifying hiS'/heA project olliee in 
the event c£ a iciXhdAawal o£ a pupUl being leAvictd, $ 

Each project tcill establish its own pAoceduAe IqA notification. 

. Remove pott copy £xon active IXle „ 

, - blAite in exit code nwnbexs [set manpal) A \ ' 

u toUti m ^ e manual) u " . • V • 

<f ^ii exact date is known, wAite in that date » 

* . - - il exact date is unknown, wnXte in the last 

day ol leAvice : / 

• file pink copy in tAansleA/withoOiauxil lection ol file. 
T&CEVUZE FOR EECfiyiflG TRAHSTEKS IN % 

• All tAjvis^cA loAms Aeeeived in school mil should be addAesied 
^ to CompensatoAtj Team - LeadeA* 

. . Team Le&deA will \ecoAd dott ol receipt on top ol lo*m. 
. KzAoted fyxm will be circulated 'among pAog/uvn tvicJwis Ion 

whos* pnogAam pupil app&AS to qualify, according to test acsuUs x 

• Tl space is available in an appAopAiate pAogAam, the tenehcA 
will lilt oat a new Entailment lofuH Ioa tliat pupil aiut lofutxuid 

&x> top copies to project. 5 " 
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APPENDIX F JCont'd) 

* » 

• * 

. Pink copy will be ptaced in active file. 

. 1$ Apace is not available, xeroxed 'form will be placed in > 

Waiting List section. 

PROCEDURE TOR JRQCESS1UG U£W ENTRIES . , 

Wew> entries viitliout necessary test information uxill 6^ forwarded to the. Diagnostic 
Heading Clinic aX Observation Center, or to the Reading CentcA Teacher lo\ fomcard- 
ing for diagnosis. , — 

PROCEDURE TOR TRAHSTER OR W1THVUML - fa/A7TIf/G LIST ' 

(Sending School - Transfer) 

. Enrollment Tom [all 3 pages intact) is removed^ iron $ile. 

. Wo exit information is to be *&illed in, since pupil was not serviced. 

. pupil transfers to another Cleveland schoot, then sending School J 
ide)\tification [school namt, code? room, etc.) is crossed off and * 
neu> school name is written on form. % 

• Send this entile form to new schdoli T his > will become their in- 
formation copy. Send to Team leader. 

* " — * 

* * . (Receiving School - Transfer) 

• - Team leader circulates form among eligible projects. ' Mr 

- * If spaces are lilted, form is placed in the waiting list {tie.' 

. If paptt is selected for service, either at entry or at a later 
date, a neioAorm is filled out with current information re- 
written on Ine. new form. Tixst two copies sent to Project Off-ice. 

• When new form ijs made,, old form may be destroyed. _ 

(Withdrawal) 

. Tom is removed from Waiting List section o{ iile. 

. " Vote of wLUtdrawat and place pupil left for, to be written on 
iorm. t 

* ' v 

• Torm is placed in Transfer /Withdrawal Section 

♦ 

VA1NTAIMHG THE KILE ^ Team members should be free to use the files and to keep the 
toms of tiie pupils idiom they are servicing updated. It would be each person's re- 
sponsibility tp keep filejs in order and to return them & the peAmanent.location, 
should it be^neccssary to remove them. ^ 

EM OT THE SCHOOL YEAR - ^ * f 

Kit pupils with forms^ in tiie active file at the end of the school 
year should have tlxe last "day of service entered and exit code % 
afiized.- 

The team teadcr'wiLl be responsible' for supptying information 
Irom tiie files as required for tlxe Division of Compensatory 

* * Education or Division of Research. Team members should be 

willing to assist, if requested. ' « 
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APPENDIX F (Cont'd) 



The Tcan? LzadcA uxitt be icipotiAibtc fa* tccwUng the &a£i*> 
<u diAccted by the Viviiion bc^o-u leaving £oa the 6w\ca. 



EACH FUC WILL HAVE THE FOLLOWING StCTlOUS: 



. ACTIVE - 
. VA1T1UG 

. WTHVmAL/TKAUSFEK 



\ 
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Ctevela,«c* Public Schools 
Title I Project* 



appendix, f <cont.<p Up|L ENROLLMENT FORM 



SCHOOL NAME . 



-PUPIL S HOMEROOM NO PUPIL'S GRADE 



NAME OF PERSON COMPLETING ENROLLMENT FORM 

position 3 : 



, PUPIL'S LAST NAME 



''PUPffc^FIBST NAME* 



i u i i r i 1-1 i i i i i 



PUPIL ID 



J, 



PROJECT CODE 



ENTRY DATE 



1 I I I I 



Ml 



□ 



EXIT DATE 



Original — Compensatory Educational Programs 
Duplicate — Fito 



BASIS OF ELIGIBILITY 



EXIT REASON 



Authorizing Signature 



NAME OF " * 

TEST FORM LEVEL ■ SUBTEST GRADE 



RAW ' DATE 

SCORE STANtNE %ILE ADKUti 



MRT 

8DRT 
CTBS 
CMT 



PUPIL ENROLLMENT (Check) 



' BILINGUAL CLASS 
BILINGUAL TUTORING 
CHILD DEVELOPMENT 
CLEVE. FUNO> SCHOOL 
DIAGNOSTIC CENTER 
ENG-AS-A-SEC. I^ANG 
MATH SKILLS 
PUPIL ADJUSTMENT 

re-Xding IMPAQT 



REAOING IMPROVEMENT 

REAOING STRATEGY 

_i_ RESIOENT TUTOR 

RESIDENTIAL SCHOOLS 

STAR * 

SUMMER SCHOOL 
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APPENDIX G 

Exarrolcs of Resident Tutor Project 
Reading and Mathematics Skill Tests 



285' 



APPENDIX G (Cont'd) \ 
220: VOCABULARY TEST A 



Name 



Date 



Score t £7 Pre 

. Grade JTJ Post 



DIRECTIONS: Circle the word that completes the sentence. 

Examples: Her cake Is on the L _j_ red fence 

The wagon can go 



cars 



fast 



table 
■any 



Her coat 1s 



2. She Hkes to jump 



3. Tom will eat the 



4. Mother put the toys 

. 5. Sue will bake 

6. work 1s 



7. The baby 1s 



6. Please tell ne a 



9. Janet will write a v 



around 



rope 



box 



over 



ball 



done 



hold 



plaT 



10. Father will cut the 



picture 
grass 



three 



cars 



ball 



after 



cookies 



draw 



got 



story 



letter 



seven 



bl ue 
toys 

apple 

\ 

away 
car 
eight 
asleeg 

^^Tcture 

drink 
pick 



erJc 
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APPENDIX G (Cont'd) 
122: MULTIPLICATION - DIVISION COMPUTATION TEST A 



Name 



DIRECTIONS : Write \he products and/or quotients 



Score_ 
Grade 



£7 Pre 
£7 Post 



(1) 



5 1 4 
x 3 



(2) 



$^.30 

x 2 " 



(3) 



H 2 9 
X 3 



W) 



3 I 1 



(5) 



$ 3 , ,9 3 

. x 5 



(ft) 



9 6 



(7) 



(8) 



$7.74 



2 2 1 



(9) 



(10) 



3 Li 0 6 



5 0 3 



STOP 
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APPENDIX H 
SURVEY OF PUBLIC SCHOOL TUTOR OPINION* 
N^7 



Dear Resident Tiftor: 

r 

The Cleveland Public Schools is gathering information for a report on the Resident 
Tutor Project. Your answers to the following questions will help us prepare the report and* 
make decisions about improving the progr^. Please answer all ahe questions completely 
and honestly. YOU NEED NOT SICN THE QUESTIONNAIRE . 

r ,™J Caic I: 5 * **** attached envelope to send your completed questionnaire by Friday, 
June 5,1931 to the address appearing on the envelop*. If you are in a nonpublic school 
return postage has been included to enable you to use the United States mail. Use the 
school mail if you* work in a public school. 



1. Counting this year/how many years have you been employed as a Resident Tutor? 

6 Average Years of Employment 

2. The Resident Tutor Training Workshops you attended this year covered several topics 
How effective were each of the fpl lowing workshop topics in preparing you to work 
as a, Resident Tutor? Please check the-response which corresponds to your opinion 



Workshop Topic: i . 

< • - f *■ 


Very 

Effective 


Effective 


Somewhat 
Effective 


N f ot 

Effective 


Response 


a. Completing* Resident 

JTutor Project Forms 

* and records 
— •< 1 


70% 


26% 






4% 


h Learning how to assist ' 
°' students in taking tests 


70% 


Sv. 


< 






c. Tutoring techniques 
for reading 


74% 


19% 






7% 


d. Sharing tutoring ideas 
ascng tutors 


52% ' 


- — 

33% ' 


a 

15% 






i'. Tutoring techniques 
fcr mathematics 

' % — ; — 


56% ; 


37% 


* 4% , 




3%, 



5 - IgSiafflfV to" effective were the Resident Tutor Training Workshops in preparing yoa 
to w<^pas a Resident Tutor? (Check one) * " preparing yoa 



67% 



Very 
a Effective 



M0% 
Effective 



Somewhat 
Effective 



3% 



Not \'o r 

Effective Response 



• Completed by public school tutors during 'the week of June 22, 1981. 
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Resident Tutor Questionnaire 

APPENDIX H (Cont ! d) 



4, Are there any additional areas^ou think need to be covered in the training work- 
shops to increase your tutoring effectiveness? 

22% 67% U% 

* Yos No No Response 



If you answered YES, pfease list one or two specific topics that you would like 
to see added to* the training workshops, ^ 

I would like at the Very beginning to go over all of the criteria of the program . 
It would give me a chance to start out tne year-with a cjear beginning. . .Problem, 
solving (math)... Interpersonal relations. . .Multiplication and division skills. •» 

5. Did the new Resident Tutor Pupil Data Card (yellow card) assist in simplifying 
your record keeping? 

97* 1% - 

yes No No Response 

» 1 v y 

If you answered MO, please explain what problems you encountered when using the 
Card. 

No problems were citeil. The following comments, however, were recorded: 

. ; i ' 

It helped immeasurably in compiling data at end of year. All information including 

parent contact was close at hand... The RTP Office copy and the tutor f s copy should 

have been different colors or with a box to be checked indicating original and duplicate. 

6, How* many different classroom teachers have you tutored pupils for this year? 

6 Average Number of Teachers 

*> ' ' 

7 - When you are assigned a pupil for tuV>ring in 'reading or math, do your classroom 

teachers clearly identify the specific skill to be tutored? (Please respond by placing 
' one "X" in each column). 

'.ben Pupil Needs When 4>upil Needs 

Reading Tutoring Math Tutoring 

ygfr 70% 7 Teacher always identifies specific skill 

7% 15% £) Teacher usually identifies specific skill 



il% . 15% Teacher some tines identifies specific skill 



4% Teacher seldom identifies specific skill 
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Resident Tutor Questionnaire 

• • * 0 _ APPENDIX H (Cont'd) 

°* On average, *,iow many minutes do you tutor an individual pupil during a single session? 

30 Minutes spent with each pupil. 

* - ! ^ y f 

, KQW often do you have conferences with your clajsroom teachers to review the work 
done and the progress made by the pupils you tutor? (Please check one) \ 

About once Several times , About once About once every two weeks No 
a day a week a week or less frequently Never Resn. 

37% 48% v 7% * s% 



9. Has your Project Consultant Teacher demonstrated the use of tutoring techniques with 
an/ of your pupils this year? 

flQ* 7* 4% 

Ye 



ies No 



No Response 

If you answered YES, how helpful dm you find these demonstrations? 



Very helpful Somewhat helpful Not .very helpful No^Resnonse 

If you answered NOT VERY HELPFUL, explain in what ways the assistance provided 
by the Consultant Teacher could become more effective. 

No comments were recorded. 



A 



•I i "* \ 

\ / 

10 » How often did you refer to the^ Resident Tutor Manual during the current school year? 

' , 4A% >' 48% 4% — ' ,4% 

y Very * Somewhat "~ ' — ~ 

Frequently Frequently Infrequently Never * Response 

If you answered INFREQUENTLY or NEVER, please explain why you found little use for 
the manual. 

" I have menferized most of the techniques suggested and find it beneficial to 
consult other resource material. 



11* Ho* helpful 'is the Resident Tutor Manual .as a source of ideas for tutoring activities? 

74% 22% 4% ^ 



Very > Somewhat Not Very 

Helpful " ^ Helpful Helpful Response 



Resident Tutor Questionnaire 

APPENDIX ^(Cont'd) 



12. do you feel that tKe Resident Tutor Manual should be improved?^ 

48% 44% 8% 

Yes ~~8o • , No Response 

If you answered .YES, please list one or two specific suggestions for improvement. 
The work is too easy that is being used from the manual... RTP tests should be mor e 
difficult. . .A vocabulary test geared for 3rd 5 4th grade. . .Complete revision of every 



reading test with an appropriate test devise<J for each grade level. . .Skills, to be 



learned in each grade. 



13. tfhat has been the greatest problem you have encountered as you tutored students 
this^ current school year? 

' «* 

One change^ after another. My kids were taken away by othgr Title I teachers/*. 

My problems was with the teachers who didn't Want to live up to the schedule you 
agreed on and would punish the children and not let them come. . .Attaining^propea racial 

balance... Having to keep an overy detailed plan book... Poor attendance' for students. 
14 • rtiat changes would you recommend to improve the project next year? 

Make RTP test a- little* harder and more creative reading. . .Too much time Is being.. 

consumed b% paperwork and bein^ forced to rapidly^fcurn over tutees. . .Select our .tut ees 

at the same time as other Title I programs in our building. . .Not have to* be last to 
choose our tutees. . .More time with less children. Most children love. being tutored . 

Shorter meetings and not so manyi..I feel the SO sessions for some pupils are not 
enough...! find that 5 the tutor vocabulary tests are too easy for fourth and fifth 
graders as a whole... Much less emphasis on SDRT and justifying every action that the * 
teacher (classroom) and tutor know is helping the student educationally. 

15. What has been your greatest project accomplishment this current school year? 

The progress of the tutees. . .Able to interest more parents irt how the project works.. . 

Most of the students mastered the skill that was taught. . .Aside from the improvement 

in test scores and attendance, I feel that the charigc in attitude was very positive. 
Some of our children were apprehensive about their new school setting. 'All this week 

t I heard 0 numerous comments about how glad they will be should they return to our next ' 

~T* *- ' 

year... My 4th grade children have not failed a reading or spelling test since I have 



been tutoring them. ..Pupil gains in SDRT tests. 
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APPENDIX I 

SURVEY OF NONPUBLIC SCHOOL TUTOR OPINION * 
N-9 



Dear Resident Tutor: 1 

The Cleveland Public Schools is gathering information for "a report on the Resident 
Tutor Project, Your answers to the following questions will help us prepare the report and 
'nake decisions about improving the pro gran. Please answer all £fce questions completely 
and honestly, YOU NEED NOT SIGN WE QUESTIONNAIRE, 

r » 

Please use the attached envelope to send your completed questionnaire by Friday, r 
June -5 ,1981 to the address appearing on the envelope. If you are in a nonpublic school 
t#tum, postage has been included to enable you to use the United States nail. Use the 
school nail if you work in a public school. 



_ !• Countingyihis year, how many years have you been employed as a Resident Tutor? 



Average Years of Employment 



2, The Resident Tutor Training Workshops you attended this year covered several topics. 
How effective were each of the following workshop topics in preparing you \j> work 
*s a Resident Tutor? Please check the- response which corresponds to your opinion". 



' Workshop -Topics 


Very 

Effective 


Effective 


Somewhat 
Effective 


Not 

Effective 


p 

No 

Response 


a. Completing Resident 
. Tujtor Project Forms 
and records 


78% 


22% 






i 


k Learning how to assist , 
°* students in-*ajcing" tests 


67% 


33% 








c. Tutoring techniques 
for reading ' 


56% 


33% * 


v 11% 






d. Sharing tutoring ideas 
among tutors 


56% 


33% 


11% 




V 


o. Tutoring techniques 
for mathematics 


67*. 


33% : 


m — 







3* Overall , how effective were*" the Resident Tutor Training Workshops in preparing you 
to work as a Resident Tutor? (Check one) 



56% 
Vpry ~ 
Effective! 



44% 



Somewhat 

Effective Effective 



Not No 
Effective Response 
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Resident Tu*or Questionnaire * > APPENDIX Si (Cont »d) 



Are there any additional areas you think need to be covered in the training work- 
shops to increasejyour tutoring 'effectiveness? 4 * * 



33t 67% 

Yos No ^o kesponse 



if you answered YES, please list one or two specific topics that you would like 
to see added to the training workshops. * 

Actually allowing totors to participate more with theix own ideas and input for th e 

workshops... How to handle a cKild who is known as a "troublemaker". ./Topics or ide as 

that will help the 'really slow students comprehend whatever skill they ar e in... 
/v 5 I ~~ I - : 

5. Did the new Resident Tutor Pupil Data Card (yellow card) assist in simplifying 
your record keeping? • 

. '* 89% . &l\ - 

Yes no No Response 

« . 2% 

If you answered NO, please explain what problems you encountered when using the 
^ Card. - ^ r 

,It addedfto the paperwork because it did not eliminate the pupil data forms. 

Several important items are omitted from the card. 



6» How many different 'classroom teachers have you tutored pupils for^this year? * 

S 



, Average Number of Teachers m \ 

I - » 

7 * When you are assigned a pupil for tutoring in reading or math, do your classroom ♦ 
teachers clearly identify the specific- skill, to be tutored? (Please respond \|>y placing 
- one "X" in each column). ^ ' 

-* 

.ncn Pupil Needs When Pupil Needs 

Reading Tutoring Math Tutoring 

67 * ' 67% Teacher always identifies specific skill 

22 * " " 11* Teacher usually identifies specific skill 

r 11^ , * « , ff* Teacher sometimes identifies specific skill 

— , Teacher seldom identifies specific skill 

* + 
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Resident Tutor Questionnaire , 

APPENDIX I (Cont'd) ' 

8 * On average, how many minutes do you tutor an individual pupil during a single session? 

28 Minutes spent with each pupil. ' 

low often do you have conferences witn your classroom teachers to review the work 
done and the progress made by the pupils you tutor? (Please check one) 

About once Several times About once About once every two weeks No 
a day a week a week or less frequently Never Jtespor 

44% 34% 11% U% „ 



Has your Project Consultant Teacher demonstrated the use of tutoring techniques with 
any of your pupils this year? 

i 

ies * no 

If you 'answered YES, how helpful d»you find these demonstrations? 

Not very helpful* No Response 



67% / 22% -- jn 

Very helpful Somewhat helpful Not very helpful' No Resp 



,If you answered NOT VERY- HELPFUL; explain in what ways the assistance provided 
by the Consultant Teacher could become more effective . — 

No comments recorded by respondents. [ 



lp- How. often did you refer to the Resident Tutor Manual during the current school year? 

33% 44% 23% — 

Very Somewhat 



Frequently Frequently Infrequently Never Response 

If you answered INFREQUENTLY or NEVER, please explain why you found little use for 
the manual. 

Classroom teachers find the manual outdated. . .Only used manual as anWteif key . . . 



It needs updating . 



11. Nov helpful is the Resident Tu^or Manual as a source of ideas for tutoring activities? 

44% 34% 11% 11% 



\o 



Very Somewhat Not Very 

helpful « Helpful Helpful Resnonse ^ 



Resident Tut^r Questionnaire 

APPENDIX I (Cont'd) 

12. Do you feel, that the Resident Tutor Manual should be inproved? 

^ I es no No Response 

If you answered YES, please list one or two specific suggestions for improvement. 

» 

Readin^and math tests -according to grades. Also, some fractions. . .Testing \ 
does not meet the needs of the in-between student. It's either too hard or too ^ 
easy... Some words listed in the spelling test are wordAhat are seldom used... 
v More ideas. ..Tests are too simple for students. . .Update of tests... 

^3. What has been the greatest problem you have encountered as you tutored students 
this current school year? . . 

* ( Keeping tutees interest ater a short time... Not being able to keep the children 

- until mastery was accomplished. .„ Disc ipl in in g the students. . .Record keeping... 

Children not wanting to^leave when the 20 or 30 minute s essions'are over^. . ' 

14. What "changes would you recommend to improve, the project next year? 

Making sessions last^ly until the student accomplishes the skill. Thirty sessions 

' - \ 1 

are too long for some student s...! would like to have more RTP tests for each grade 

level... A cutback in all paperwork. . .Not so many workshops, if so only a half day 
so we may return to our school and work with children... A new up-dated- manual. 

15. What has been your greatest project accomplishment this current school year? ' 

Getting my children to have some gain in the skills that I worked wit'h them... When 
a teacher tells you that a pupil has improved immensely in a particular skill. 
To have helped som^|tutees that at one time were considered, to be retarded. » .Working 
with children that have improved greatly with. a little tutoring. Also, asking our 

input with this questionnaire. * • 



1 
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* APPENDIX J 

Survey -of Tbtory Who Mot* Responslpic for 
Administering parent Resource Centers 
M-13 

' PLEASE. IfESPOND TO THE FOLLOWING QUESTIONS IF YOU MANAGE A PARENT RESOURCE CENTER IN 
YOUR SCHOOL. 

Indicate how much you AGREE or DISAGREE with each statement appearing below by 
placirfg an "X" in the response box which most closely corresponds to your honest 
opinion. 



N-13L 


Strongly 
Agree 


AgTee 


Not 
Sure 


Disagree 


Strongly 
Disagree 


a. It is very difficult to get parents 
to use the Resource Center.^ 


15% 


\ .40% 


15 


15 


15 


b. , Classroom teachers in my, building 
believe the Resource Center is 
rfeeded in this school. 




38% 


8% 






c. The Resource Center has an adequate 
number of instructional materials. , 


31% 


54% 




8% 


a— 

8% 


d. The principal of my school feels 
that the Resource Center offers an 
important service to parents . 


69% 


15% 


8% ' 
• 


i 


«•» 


e. I am glad that our school Has a 
Resource Center. 


' ' 77% 


15% 




r 


8% ' 


f. Parents 'like the Resource Center 1 s 
instructional materials. 


i 

38% 


62% 






> 


g. The classroom teachers in my * 

building understand how the Resource ' 
Center can help parents. 


38% 


S4% 


8% 






» T 

h. , I have been adequately trained in 
how to manage the Resource Center. 


69% 


31% 




\ " ' 




y ' ) 

*i. s^tudents benefit by haying a Resource 
.Center in their school . 


85% 


15% 


i 
\ 


i i 

! i 



ERIC 



296 

-297- 



APPENDIX K 



SURVEY OF NONPRQJECT TEACHER ' OPINION* 
(Public School Survey) N 
N-21 



Dear Teacher: ' 



The Division of Research and Development is collecting information and 
opinion from a sample of teachers who received service from the Resident 
Tutor Project this year. The information you provide will be used to try 
to improve project operations. Please answer all the questions completely, 
and honestly. You need not sign the questionnaire , 
> 

Please use the attached envelope to send your completed questionnaire 
by Friday, Jun* 12, 1981-' to the address appealing on ihe envelope, if you 
are in a non-public school return postage has been included 'to enable you to 
use the United States mail.. Use the school mail if you work in a public 
school. 1 v 

• • 

Thank You t 



1. How many children in your* class ha^e-received Resident Tutor service this year? 

7 Average Number of Children • 

2. On average, how many days per week does a ^upil work with a tutor? 

4 Average days per week 

3. How often are you able to' actually observe how the Resident Tutor works with 
your students?. % „ 

5% 10% * 5% 19% " 61% 



Aboiit once Several times About once About once every two ** IJever 
a day a week- , a week y weeks or less frequently 

4. How often do you have conferences wi 4 th the Resident Tutor to review the work done 
and the progress made by the tutee? 

19% 24% * 43% 14% 



About once Several times About once About once every two Never 
a day a week a week weeks or less frequently 



* Completed by public school teachers during week June 8, 1981. 
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APPENDIX K (Cont'd) 

, i 

Indicate whether or not^you have witnessed, an improvement in student reading 
and/or mathematics skills as a result o& participating in the Resident Tutor 
Project. » m 

71% loi 19% 



* Improvement No Change Unable to Assess 

If you answered NO CHANGE, explain why you feel students who were assisted 
4 by the tutor did not maJce any progress. > 

Too far behind... Not seen often enough.. *4fith overcrowded classes it* gives < 

children who have unique problems an opportunity fo receiye some individual 

— : — 1 ' — " 

assistance... , ^ « 

6. Do you feel that the Resident Tutor Project adequately supports the instructional 
•r program in your school? 

Yes 76% No 19% No Response 5% y 

Why or why pot? (Please explain) Too limited in areas to be covered- 1 need m ath 

t help but she could only work with reading. . .Because you can target areas for the 

< - tutor to aid the student in, . .Children are always waiting to be. serviced. . .The 

^Resident Tutor is use d more as an office assistant than as a tutor. 

7. From your experience this year, what has been the most valuable ieaxUM or exfect 
^of the Resident Tutor Project? 

Individualized attention provided to the students has improved their self-concept... 
: ■ * ■ 

The pupils's enthusiasm for the project is noticeable. . .Children have tried to do 

better with their regular class work. . .Students were motivated' to try harder. 
^ — . 

8. Ape there changes you would like to see in the Resident Tutor Project to make it 
'more beneficial to the students? If so please specify suggestions. 

More contact with teacher in setting objectives for students:. .Some type of M j>re- 

cription" lessoiuplan devised by tutor and teacher to focus on weaknessess. . . 

, _t 

Tutor could wofk with more children. . .Many times a child needs additional help when 
the 30 lessons are over... The tutor should spend more time tutoring-less time passing 
out checks. : * r ~^ 

9 * Have you ever withdrawn a child from Resident Tutor services? — Yes 100% No 

No comments were recorded. * * ' 
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' APPENDIX K (Cont'd) 



10. Has uorking with a Resident Tutor created any prbbleras for you? Briefly describe 
any. 

There were a fcw^problcms'wfth scheduling, but we were able to work them out... . 
Slightly, worry about the fact that the child is out of.the room and-missing 

school work.,.. No, the Resident TutoV helps students. When the tutor helps, the 

students are able to work better on their own. 1 
— — — ■ ■ — * r ■ 

XI, Do you have any additional comments you would like to make relative to the 

- operations of this project? ► 

I think that the Resident Tutors are great help to all the students .that they 



work with ... I just hope the project con tinues. . .Jh is is the first time I have 
ever seen a tut or used by the office as an office assistant.-. . I have worked with 
tutors before. If the principal is allowed to use- the tutor as an offj.ee assistant 

\ : : ; ; ; 

the Resident Tutor Project will'be destroyed. . .It is my hope that this project 





% 


remains 


intact or is Expanded. .ft 


feel that we are fortunate to have such a fine 






tutor. 


She has been a fine asset 


to our instructional staff. ..Keep it going... 













\ 
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APPENDIX I 
SURVEY OF NONPROJEfr TEACHEd OPINION * 
(Nonpublic School Survey) 

N-10 



Dear Teacher: 

The Division of Research and Development is collecting information and 
opinion from a sample of, teachers who received service from the Resident 
Tutor Project this year. The information you provide will be used to try , 
to«improve project operations. Please akvrer all the questions completely 
and honestly. You need not sign the Questionnaire . 

Please use the attached envelope to sendyour completed questionnaire 
by Friday, June 12, 1981 to the address appearing on. the envelope, if you 
are in inon-public, school return postage has been included to enable you to 
use the United States mail. Use the school mail if you work in a public 
School./ r 

Thank You 



1. How many children in your class have received Resident Tutor service this year? 

8 Average Number of Children 

2. On average, how many days per week ddes a pupil work with a tutor? 

* 4 Average days per week 



How often are you able to actually observe how the Resident Tutor works with 
your students? 

10* 50% 20% " 1Q* 10% 



About once Several times About once . About once every two Never 

a day a week' a week " weeks or less frequently 

4. How often do you have conferences with the Resident Tutor to review the work done 

and the progress made by the tutee? £ 

10% 60* 20% 10% 

About once Several times About once About once every two Never 

a day a week a week weeks or less frequently 



Completed by nonpublic school teachers during the week of. June 8, 1981. 
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Indicate whether or not you have witnessed an improvement in student reading 
and/or mathematics sjcills as a result of participating in the Resident Tutor 
Pro j ect . 

100% v 



Improvement No Change Unable to 

If you answered NO CHANGE, explain why you feel students who were assisted 
by the tutor did not make anyprogress. 

No comments were recorded. 



6. Do you feel that the Resident Tutor Project adequately supports the instructional ' 
program in your school? 

Yes 90% No -- Somewhat 100% 

* Why or why not? (Please explain) I had to give our tutor material to use when 

working with students. The project material for reading* is not up -to-dat^.*. . Gives 

confidence to frustrated children. .. Individualized program. x . The children really 
improved ... Could use more conference time with tutor. ..very flexible. 

7. From your experience -this year, what has been the most valuable fe^fur* or^fect 
of the Resident Tutor Project? 

Students who participate in the project usually don't get too much praise within 

the regular classroom, the tutor can do so. . .Reinforcing basic skills on an individual 



basis. . .Consistency of program. . .Re- inforcement of classroom material../ 

r 

Are there changes you would like to see in the Resident Tutor Protect to make it 
more beneficial to the students? If so please specify suggestions. 

The teacher and tutor should plan an agenda as to what is to be covered withi the 
year in reading. . .More drill materials for the tutor to work with... Work with 
teachers a little closer and implement more things that are being included in the 

regular classroom at that time... . 

Have you ever withdrawn a child from Resident Tutor services? Yes 20% No 80% 



If you answered YES, explain for what reasons you 'tool; this action. 

Improvement warranted it... Yes, because he ^had so improved and there was another 

* • 

student who needed help... » 
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APPENDIX L (Cont'd) 



10 r Has working with a Resident Tutor created any problems for you? # Briefly describe 

any . * , 

Yes - Some in scheduling, . .None - Very beneficial. . .Scheduling is difficult... 



11. Do you have any additional comments you would like to make relative to the 
operations of this*praject? 

No comments were recorded. 



r 




ft 
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APPENDIX M 
N«32 



RESIDENT TUTOR PEIHCIPAL'S QUESTIONNAIRE 




The Resident Tutor Project Is col lectl information from principals • 
receiving service from the Resident Tutor Projfl£ rVou need n ot sign this 
Questionnaire . ~~ — 3 — a — 

p^f 1 ^ 56 u ?o ^enclosed envelope to send your completed questionnaire by 
rnaay, June 1Z, 1981. 

1. The educational aide was assigned to provide tutorial services in specific 
skills, how would you rate the services that were given? 

72 * Excellent \ 22 * 6ood - Poor 30% No 

V 1 Respons 

2. Plefse check the Ijinds of feedback you have received regarding the tutor 1 * 
services: 

— Formal Observation 94% inform] Observation 

91% 

Teacher's Comments 78% Parent's Conrents 

Pupil's Comments 38% other Adults 
Room Appearance Other 



66% 



59% 



\ Formal monitoring teams (federal, state* local, etc.) 



3. List any topics you feel should be covered in staff development workshops 
for tutor ( s? - y 

a. Parent awareness of program. <j # Goals of " the Language-arts program 

b. Positive approach to discipline e< Working cooperatively with staff 

c. Activities to be used in developing f Prescription method for instruction 
specific skilfe '* ^ 

*> * 

4. What do you feel are the best features of the project and deserve expansion? 
Materials for parents. . .Comprehensive tutor's' guides .One to one, friendly, warm 
concerned, a. attitude of tutor. . .Diagnostic screening and prescriptive tutoring... 
Continuation of reinforcing skills recommended by the classroom teacher. . .Dedication/ 
interest of tutor. . .Flexibility in working with students. . .Remediation, extend to 
all gr*|s. 

5. What features ff the project do you feel need modification and/or deletion? 
More emphasis on teacher judgement in addition to test ^scores. . .Sometime to rigid 
standards. Program must serve children not vice-versa^. .All children* whom the class* 
room teacher feels need help should be tutored despite the percentile rank on 
standardized tests. . .There would appear to be a great volume of paperwork. . .Narrow 
limits of skills utilized. More experienced tutors should be allowed to broaden 
concepts covered... Limitation of services. 

6. If the school houses a Restdent Tutor Parent Resource Center, please rate Its 
worth to parents, staff and pupils: 

7» Excellent 29% Good „ - Poor y 

7. List any educational materials you feel should be added to the Resource 
Center inventory: 

Magazines ^ Practice sheets of various concepts 

b« More reading materials e. More books for 5th and 6th grade 

C. List of what is available should be # ^ _ _ _ . , 

given to teachers and parents f# More concrete materials 

THANKS AGAIN FOR YOUR INPUT!! 
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Har1ene>McMt31an, Project Manager 
Resident Tutor Project 
Observation Center, Room 1(J5 
2064 Steams Road 
Cleveland, Ohio 44106 



** APPENDIX N 

SURVEY OF STUDENT OPINION* 
N-55 

DEAR -STUDENT: 

DURING THE YEAR YOU HAVI: HAD A TUTOR HELP, YOU IN SCHOOL. WE WOULD LIKE TO 
KNOW HOW YOU FELT ABOUT GETTING THIS HELP. READ EACH SENTENCE BELOW. 
. IF YOU AGREE KITH THE SENTENCE PUT AN "X" IN THE YES BOX 
. IF YOU DISAGREE WITH THE SENTENCE PUT M X" IN THp NO BOX 
. IF YOU CANNOT MAKE UP YOUR MIND PUT AN "X" IN^JiE NOT SURE BOX 



1. I LIKED GETTING HELP FROM MY TUTOR. 

96* YES 
-- NO 
- 4* NOT SURE 

e ' 


S. MY FRIENDS WANT TO GET HELP FROM 
MY TUTOR. 

40% YES 

11%. NO 

49%, NOT SURE 


2. MY TUTOR HELPED ME TO DO BETTER s 
IN SCHOOL 

95V YES . , 
NO 

S% NOT SURE 


6. I WOULD LIKE TO GET HELP FROM. MY « 
TUTOR NFXT YFAR 

76% YES 
7% NO 

17% NOT SURE 


3. I LIKED THE THINGS MY TUTOR GAVE 
ME TO WORK WITH. 

87* YES 

10% NO 

. 12V* NOT SURE 


7. MY TUTOR HELPED ME WITH THINGS 
THAT I COULD NOT DO WELL. 

95% YES . * 

-2% NO 

3% NOT SURE 


4 . THE TESTS MY TUTOR GAVE ME 
SHOWED HOW WELL I LEARNED. 

*S\ YES ' 

IV NO 

.U\ NOT SURE 

-j : '-, 


8. MY TEACHER WAS HAPPY THAT I GOT ' 
HELP FROM MY TUTOR. 

93% YES 

NO 

7* NOT SURE 



•Administered during the week of June 22, 1981. 



-305- 



